Sr. Data Engineer - Databricks

<p style="text-align:left"><b>Job Title</b></p>Sr. Data Engineer - Databricks<p style="text-align:inherit"></p><p style="text-align:left"><b>Position Overview</b></p><p>We are looking for a data engineer to join our enterprise analytics team! This individual will partner with data scientists, analysts and product owners to support data science projects and initiatives across the enterprise – including in our manufacturing, planning/forecasting and customer service areas.</p><p>Applicant must be an experienced data pipeline builder who enjoys building solutions from the ground up. We are looking for someone who is self-directed and comfortable supporting the data needs of multiple teams and projects.</p><p></p><p><b>Responsibilities:</b></p><ul><li><p>Partner with data scientists, data analysts, data stewards and product owners to understand data needs and develop solutions</p></li><li><p>Design, build, launch and maintain efficient and reliable data pipelines to support data analysis and machine learning models</p></li><li><p>Define and manage standards, guidelines and processes to ensure data quality</p></li><li><p>Assemble large, complex datasets based on business requirements</p></li><li><p>Identify and deploy various methods and techniques for optimal extraction, transformation and loading of data from a wide variety of data sources</p></li><li><p>Help build and maintain best practices for our data engineering strategy – identifying and addressing gaps in existing processes and solutions</p></li></ul><p></p><p><b>Minimum Qualifications:</b></p><ul><li><p>Bachelor’s degree in a quantitative field (e.g., Computer Science, Engineering) or a related quantitative field or equivalent work experience is required.</p></li><li><p>At least 4-6 years of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.</p></li><li><p>Expert SQL programming skills</p></li><li><p>Expertise in at least one relevant object-oriented programming language (e.g., Python, Scala)</p></li><li><p>Experience building and optimizing data pipelines, architectures and data sets</p></li><li><p>Experience with big data tools (Spark, Kafka, etc.)</p></li><li><p>Experience in data warehousing and data modeling</p></li><li><p>Good knowledge of data management, data integration, and database development techniques with a good understanding of data architecture principles</p></li><li><p>Strong analytical and problem solving skills</p></li><li><p>Ability to communicate across all levels of the organization and work with diverse project teams</p></li><li><p>Experience using cloud-based infrastructure such as Azure and AWS</p></li><li><p>Experience in DevOps best practices including CI/CD, process automation and optimization</p></li></ul><p></p><p><b>Preferred Qualifications:</b></p><ul><li><p>Experience with designing and implementing real-time pipelines</p></li><li><p>Experience with data quality and validation</p></li><li><p>Experience working in an Agile environment</p></li></ul><p></p><p><b>Required Competencies:</b></p><ul><li><p>Make Effective Decisions</p></li><li><p>Drive Results</p></li><li><p>Demonstrate Strategic Influence</p></li><li><p>Demonstrate Customer Orientation</p></li></ul><p></p><p>The position may be filled as a data engineer or senior data engineer based on experience.</p><p style="text-align:inherit"></p><p style="text-align:left"><b>Work Shift</b></p>8 Hr non-rotating shift, Hrs fall to in punch day, Observed Calendar, shift starts AM<p></p><div>Shaw Industries is an equal opportunity employer as to all protected groups, including protected veterans and individuals with disabilities.</div>