Title Azure Data Engineer with SCM

Location: Dallas, TX(Onsite)

Duration: Long Term

Mandatory: 12+ years of IT experience

Domain Experience: SCM (Supply Chain Management) or CPG (Consumer Packaged Goods) or Revenue Management

Responsibilities:

Mandatory: 12+ years of IT experience
Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database
Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.
Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.
Some experience of using big data technologies like Hadoop, Spark, Airflow, NiFi, Kafka, Hive, Neo4J, Elastic
Search.
Good Understanding of different file formats like Delta Lake, Avro, Parquet, JSON and CSV.
Experience of working in Agile projects and following DevOps processes with technologies like Git, Jenkins & Azure DevOps.
Good to have:
Experience of working on Data Lake & Lakehouse projects
Experience of building REST services and implementing service-oriented architectures.
Experience of supporting BI and Data Science teams in consuming the data in a secure and governed manner.
Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE)