Job Summary:
The Senior Data Engineer is responsible for designing, developing, and managing the data infrastructure and pipelines within an organization. This role plays a crucial role in ensuring that data is collected, processed, and made available for analysis and decision-making. Duties include identifying a company’s internal and external data sources, collaborating with stakeholders to determine data and organizational needs, and using the information to create and maintain data infrastructure and pipelines.
Essential Functions:
- Analyze and organize raw data.
- Build data systems and pipelines.
- Evaluate business needs and objectives.
- Interpret trends and patterns.
- Conduct complex data analysis and report on results.
- Prepare data for prescriptive and predictive modelling.
- Combine raw information from different sources.
- Explore ways to enhance data quality and reliability.
- Identify opportunities for data acquisition.
- Develop analytical tools and programs.
- Collaborate with data scientists and architects on several projects.
- Other duties as assigned.
Required Skills/Abilities/Competencies
- Excellent verbal and written communication skills.
- Great numerical and analytical skills
- Ethical and Critical Thinking
- Excellent interpersonal and customer service skills.
- Excellent sales and customer service skills.
- Excellent organizational skills and attention to detail.
- Excellent time management skills with a proven ability to meet deadlines.
- Strong analytical and problem-solving skills.
- Strong supervisory and leadership skills.
- Ability to prioritize tasks and to delegate them when appropriate.
- Ability to function well in a high-paced and at times stressful environment.
- Proficient with Microsoft Office Suite or related software.
- Knowledge of programming languages.
- Advanced knowledge and experience with Cloud data warehouses/databases.
Education and Experience:
- 5-8 years’ experience as a data engineer or similar role.
- Degree in Computer Science, IT, or similar field; master's degree
- Data Modelling experience.
- ETL/ELT data integration experience with tools such as Matillion, Talend, 5Tran.
- Advanced Skills and hands-on experience with Azure Platform and data tools. Azure Data Factory, Synapse, ADLS, Logic Apps, Azure SQL, etc.
Physical Requirements:
- Prolonged periods of sitting at a desk and working on a computer.
- Must be able to lift up to 15 pounds at times.