Data Engineer
Salary & Market Data
Matched to BLS occupational data · Pennsylvania
Job Description
DATA ENGINEER Position Summary
The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization’s data strategy and broader goals. This role involves implementing ETL processes to ensure data accuracy and availability, optimizing data workflows for performance, and providing guidance on visualization tools like Power BI. The Data Engineer is responsible for monitoring and troubleshooting data pipeline issues, developing comprehensive documentation, and staying updated with the latest trends in data engineering. Collaboration with cross-functional teams is essential, as this role supports the creation of innovative and efficient data solutions that drive strategic decision-making and operational success. The ideal candidate is proficient in programming languages such as Python, Java, or Scala, and has a strong understanding of data governance and security best practices. This position is pivotal in ensuring the integrity and performance of the organization’s data infrastructure, aligning with the company’s commitment to excellence and innovation. Essential Duties Data Pipeline and Architecture Design, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric. Implement ETL processes to ensure data accuracy and availability. Optimize and tune data workflows for performance and scalability. Visualization and Guidance Provide guidance on visualization tools, focusing on Power BI. Contribute to guidelines and standards for visualization techniques and analytic dashboards. Monitoring and Troubleshooting Monitor and troubleshoot data pipeline issues, ensuring timely resolution. Documentation and Best Practices Develop and maintain documentation for data processes, architectures, and workflows. Stay updated with the latest trends and best practices in data engineering and Microsoft Fabric. Additional Duties: Tasks or duties not outlined in this job description may be required to contribute to the organization's success and efficiency. Qualifications
Education & Experience: Bachelor’s in computer science, data engineering, statistics, mathematics, or related fields. 5 years in data visualization, data mining, and analysis using Power BI Proven experience as a Data Engineer, with a focus on Microsoft Fabric. Ability to write complex SQL queries. Experience with Azure DevOps Git for version control. Experience creating data pipelines within Fabric workspace to transfer transformed data from Lakehouse to warehouse tables within Fabric workspace. Understanding of data governance and security best practices. Tools & Systems: Proficiency in programming languages such as Python, Java, or Scala. Familiarity with cloud platforms such as Azure. Experience with CI/CD pipelines and automation tools.
The role involves frequent use of standard office equipment, such as computers, phones, and printers.
The Data Engineer plays a crucial role in designing, developing, and maintaining scalable data pipelines and architectures using Microsoft Fabric, significantly contributing to the organization’s data strategy and broader goals. This role involves implementing ETL processes to ensure data accuracy and availability, optimizing data workflows for performance, and providing guidance on visualization tools like Power BI. The Data Engineer is responsible for monitoring and troubleshooting data pipeline issues, developing comprehensive documentation, and staying updated with the latest trends in data engineering. Collaboration with cross-functional teams is essential, as this role supports the creation of innovative and efficient data solutions that drive strategic decision-making and operational success. The ideal candidate is proficient in programming languages such as Python, Java, or Scala, and has a strong understanding of data governance and security best practices. This position is pivotal in ensuring the integrity and performance of the organization’s data infrastructure, aligning with the company’s commitment to excellence and innovation. Essential Duties Data Pipeline and Architecture Design, develop, and maintain scalable data pipelines and architectures using Microsoft Fabric. Implement ETL processes to ensure data accuracy and availability. Optimize and tune data workflows for performance and scalability. Visualization and Guidance Provide guidance on visualization tools, focusing on Power BI. Contribute to guidelines and standards for visualization techniques and analytic dashboards. Monitoring and Troubleshooting Monitor and troubleshoot data pipeline issues, ensuring timely resolution. Documentation and Best Practices Develop and maintain documentation for data processes, architectures, and workflows. Stay updated with the latest trends and best practices in data engineering and Microsoft Fabric. Additional Duties: Tasks or duties not outlined in this job description may be required to contribute to the organization's success and efficiency. Qualifications
Education & Experience: Bachelor’s in computer science, data engineering, statistics, mathematics, or related fields. 5 years in data visualization, data mining, and analysis using Power BI Proven experience as a Data Engineer, with a focus on Microsoft Fabric. Ability to write complex SQL queries. Experience with Azure DevOps Git for version control. Experience creating data pipelines within Fabric workspace to transfer transformed data from Lakehouse to warehouse tables within Fabric workspace. Understanding of data governance and security best practices. Tools & Systems: Proficiency in programming languages such as Python, Java, or Scala. Familiarity with cloud platforms such as Azure. Experience with CI/CD pipelines and automation tools.
The role involves frequent use of standard office equipment, such as computers, phones, and printers.
Important Notice
This listing was syndicated from Adzuna. We strive to keep information accurate, but do not assume responsibility for the content of this posting.
- Use the Apply button above to contact the employer directly
- Verify the employer and position details before applying
- Review our Terms of Service for listing policies
