Job Description
Required Core Skills:- Data Processing for Python Development and optimize ETL processes using Databricks and related tools like Apache Spark. Containerization Utilize Docker for packaging Databricks workloads- Ensuring portability and reproducibility.- DevOps Practices Implement CICD, automation, and version control for Databricks workflows.- Handson experience on setting up DevOpsDataOps using BitbucketGitlab or other related tools.- Environment Management Set up and manage Databricks clusters and ensure optimal runtime.Minimum years of experience: 5-7 yearsDetailed Job Description:- 5-7 years of experience in Data Processing for Python Development and optimize ETL processes using Databricks and related tools like Apache Spark. Containerization Utilize Docker for packaging Databricks workloads- Ensuring portability and reproducibility.- DevOps Practices Implement CICD, automation, and version control for Databricks workflows.- Handson experience on setting up DevOpsDataOps using BitbucketGitlab or other related tools.- Environment Management Set up and manage Databricks clusters and ensure optimal runtime.IBU Consulting
Apply
Go Back