Qualifications
- 5 years of experience in databricks, python
- To develop and deliver codes for the work assigned in accordance with time, quality and cost standards
- Ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets
- Experience in building ETL data warehouse transformation processes
- Big Data technologies Hadoop, Spark, HIVE, Kafka
- Experience in Databricks(Azure\AWS), Apache Spark, Python , SCALA, Oracle, SQL Server and other related frameworks
- CICD (preferred with Azure DevOps)
- Should have strong experience in using Python\Scala for data ingestion rather than analytics.
- Good to have exposure to other Open Source big data products Hadoop (incl. Hive, Pig, Impala)
- Excellent Problem-solving skills with an innovative and proactive approach
