Job Description
Job Title: Senior Azure Data Engineer
Location: Richmond, VA or Dallas, TX (Hybrid)
Duration: 6-month contract to hire with FTE potential
Job Summary: We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. Reporting to Zafar, the Director of Data Engineering, and working closely with Joseph (Manager) and Ani (Solution Architect), the ideal candidate will have a strong background in data engineering, cloud computing, and specifically, expertise in Microsoft Azure. This role involves designing, developing, and maintaining data solutions on the Azure platform to support our data-driven initiatives. The initial assignment is for 6 months, with potential extension up to 2 years.
Requirements: - zure Data Factory
- zure Data Lake Storage
- Databricks
- Spark (using Python, open to seeing Scala/Java)
- SQL
Nice to Have: - JD Edwards
- Salesforce
- zure Functions
Key Responsibilities: - Design and implement scalable data pipelines and ETL processes using Azure Data Factory and PySpark.
- Develop and maintain data storage solutions using Azure SQL Database, Azure Data Lake, and Databricks.
- Migrate data from various sources including Salesforce, JD Edwards, Oracle, Postgres, NoSQL databases, and OLTP systems to Databricks Lakehouse and Data Lake.
- Implement Medallion architecture, focusing on ingesting data into the bronze layer and supporting additional modeling and refinement to drive to the gold reporting layer.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Optimize and tune data solutions for performance, reliability, and cost-efficiency.
- Ensure data quality, integrity, and security across all data solutions.
- Monitor and troubleshoot data pipelines and systems to ensure smooth operation.
- Stay up-to-date with the latest Azure technologies and best practices in data engineering.
Qualifications: - Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5+ years of experience in data engineering, with a focus on cloud-based solutions.
- Strong expertise in Microsoft Azure, including Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake.
- Proficiency in SQL, Python, and other relevant programming languages.
- Experience with data modeling, ETL processes, and data warehousing.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Experience with JD Edwards and Mulesoft API integrations is a plus.
- Familiarity with Azure Functions for serverless compute is a plus.
Preferred Qualifications: - Master's degree in a related field.
- zure certifications (e.g., Azure Data Engineer Associate).
- Experience with big data technologies such as Hadoop and Spark.
- Knowledge of machine learning and AI concepts.
Benefits: - Competitive salary and benefits package.
- Opportunities for professional growth and development.
- Collaborative and inclusive work environment.
- Flexible work arrangements.
RIT Solutions, Inc.
Job Tags
Contract work, Flexible hours,