Data Engineer II

Role and Responsibilities  

• Guide and front the design and development of ETL pipelines and processes 

• Collaborate with a team of data science and analytics professionals to understand how best to prepare data for further use 

• Build, maintain, and optimize existing data architecture and infrastructure 

• Enhance data quality and integrity through pressure testing and validation 

• Spearhead the development and unification of multiple systems in a microservice centric architecture 

Required Qualification & Education 

• University Degree in Computer Science, Data Science, Mathematics or a related field and 4+ years of applicable experience 

• Certification in one or more data management technologies or methodologies 

Required Skills & Competencies 

• Expertise with both SQL and noSQL database solutions 

• Experience working with both structured and unstructured data 

• Knowledge of programming languages such as Python or Ruby 

• Understanding of data warehousing concepts and tools in AWS or Azure 

• Understanding of a data lakehouse architecture, design, and implementation 

• Strong problem solving skills and a passion for high quality data management 

Required Software Knowledge 

• 2+ yrs of SQL experience 

• 4+ years of programming experience using either Ruby, Python, or another scripting language 

• Experience working within expansive AWS systems involving multiple groups of microservices 

Preferred Experience 

• Masters Degree in Computer Science, Data Science, Mathematics or a related field and 2+ years of applicable experience  

• Experience unifying systems with similar but distinct approaches to data management is a plus 

Preferred Skills & Competencies 

• Understanding of cloud computing and data management technologies in AWS (Sagemaker, Lambda, RDS, Redshift) 

• Prior history working under Agile software development methods and tooling, such as Jira ticketing, Kanban process, etc. 

• Exposure to data visualization or business intelligence tools is a plus (DOMO, Tableau, PowerBI) 

• Experience working with version control systems such as GIT