Job Description: We are seeking a talented and motivated Data Engineer with 3.5+ years of experience to join our data engineering team. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure and pipelines, enabling data-driven decision-making across the organization.
Key Responsibilities:
- Data Pipeline Development: Design, build, and maintain robust data pipelines to extract, transform, and load (ETL) data from diverse sources into our data warehouse.
- Data Integration: Integrate data from various systems and sources, ensuring data quality, accuracy, and consistency.
- Data Modeling: Develop and maintain data models and schemas for efficient data storage and retrieval.
- ETL Automation: Implement automation and scheduling for ETL processes to ensure data is updated regularly.
- Cloud Platform Skills: Proficiency in cloud data platforms like Azure Data Factory (ADF) or similar for data orchestration and processing.
- SQL Skills: Strong SQL skills for data manipulation, query optimization, and data analysis.
- Power BI Skills: Experience with Power BI for creating interactive dashboards and data visualizations.
- Data Quality Assurance: Monitor and enforce data quality standards, troubleshoot data anomalies, and implement data validation checks.
- Documentation: Maintain comprehensive documentation of data pipelines, workflows, and data dictionaries.
Qualifications:
- Educational Background: Bachelor’s degree in Computer Science, Information Technology, or related field.
- Previous experience in data warehousing and data integration projects is required. Total experience 2-5 years.
- Programming Skills: Proficiency in programming languages such as Python and DB query languages such as SQL
- Data Technologies: Familiarity with data technologies and tools, including SQL, MongoDB, Redshift , data warehouse systems.
- ETL Tools: Experience with ETL tools like Apache NiFi, Apache Airflow, ADF, or similar.
- Database Management: Knowledge of database systems (e.g., SQL databases, NoSQL databases) and query optimization.
- Data Modeling: Understanding of data modeling concepts and tools (e.g., ER diagrams).
- Version Control: Experience with version control systems like Git.
- Data Analysis: Basic data analysis skills to troubleshoot data issues and provide insights.
- Collaboration: Strong communication and collaboration skills to work effectively in a team.
- Problem-Solving: Analytical and problem-solving skills to address data-related challenges.
- Adaptability: Ability to learn and adapt to new technologies and tools.
Join our team to contribute to the development of a robust data infrastructure and play a crucial role in enabling data-driven decision-making across the organization while leveraging ADF, SQL, and Power BI skills.