Ritesh's Blog

My take on the latest in Data and AI, Smart Data Integration, DataOps, Micro-services, DataStage, Hybrid Cloud, Data Ingestion and Spark with a focus on Analytics and SaaS in Hybrid Cloud

Data and AI

Openshift – How to address RunAsUser range issue

Security context constraints commonly known as SCC within OpenShift allow administrators to control permissions for deployed assets. Enterprises now enforcing restricted SCC as a standard. It means apart from other SCC restrictions all deployments including pod or application or operator or replicas must run as a user in a pre-allocated range of UIDs. This range…

Create DataStage flow in 2 Minutes on DSaaS

    Let’s see how we can create and run a simple DataStage flow using  DataStage as a Service on IBM Cloud. Later we can extend simple flows into complex data transformation pipelines. Assuming you already have DataStage provisioned and project created as explained here. Step 1: Go to the project and click on Add to Project.…

Provision DataStage on IBM Cloud in 5 minutes – DSaaS

  DataStage is always meant to handle complex data transformations and required planning for deployment of its tiers for optimal performance and hence known as a data integration tool for enterprises.  With  DataStage SaaS offering this is the thing of the past. Now even individual users also can use this tool to handle their data…

IBM DataStage as a Service (DSaaS)

Today IBM DataStage announced the beta for its new SaaS-based data integration solution DSaaS on IBM Cloud. DataStage has undergone a complete transformation towards a modern cloud-native true micro-service-based re-architecture. With this beta, DataStage is now available on the IBM cloud as a true SaaS, cloud-first experience. Transformed DataStage should be available on IBM Cloud Pak…

Submit MapReduce Jobs to Yarn RM using REST API(s) – Oozie Workflow

Recently was exploring to integrate my MapReduce (MR) application with rest of the micro-services and their infrastructure. Available command line mechanism (e.g. using Hadoop or Yarn command from prompt) is not a recommended option here. It needs to be REST API based solution to make them consumable across applications. While exploring realized we can\’t use…

Loading…

Something went wrong. Please refresh the page and/or try again.


Follow My Blog

Get new content delivered directly to your inbox.

Design a site like this with WordPress.com
Get started