AWS Data Engineer

About AllCloud

AllCloud is a leader in amplifying organizations’ cloud potential through AI. With a track record of hundreds of successful migrations and implementations across AWS and Salesforce, AllCloud has developed strategies and solutions that enable businesses of all sizes to remain at the forefront of innovation.

AllCloud is a leader in AI-led professional and managed services. As an AWS Premier and audited managed services Partner, and Salesforce Consulting partner, AllCloud provides comprehensive AI-led cloud journey support, from initial migration to ongoing management through our Engage Managed Services. Our expertise ensures that clients remain aligned with ecosystem best practices while focusing on their core business growth.

AllCloud serves clients across the globe with offices in EMEA and North America. 

Job Summary

AllCloud is looking for a savvy Data Engineer  to join our growing team of data experts. The hire will be responsible for migrating to the cloud, and optimizing our customers’ databases and data flows and enrich our operational and functional data flows with AI/ML algorithms.

The ideal candidate is not afraid of data in any form or scale, and is experienced with cloud services to ingest, stream, store and manipulate data. The Data Engineer will support new systems designs and migration of existing ones, working closely with solutions architects, project managers and data scientists. The candidate must be self-directed, fast-learners and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or re-designing our customers’ data architecture to support their next generation of products and data initiatives and machine learning systems.

Working schedule: 10:00 AM - 7:00 PM EET

Summary of Key Responsibilities

• Keep our customers’ data separated and secure to meet compliance and regulations requirements. 
• Design, Build and Operate the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, cloud migration tools and ‘big data’ technologies.
• Optimize various RDBMS engines in the cloud and solve customers' security, performance and operation problems. 
• Design, Build and Operate large, complex data lakes that meet functional / non-functional business requirements.
• Optimize various data types ingestion, storage, processing and retrieval from near real-time events, and IoT, to unstructured data as images, audio, video and documents, and in between.
• Work with customers' and internal stakeholders including the Executive, Product, Data, Software Development and Design teams to assist with data-related technical issues and support their data infrastructure and business needs.

Requirements

Must-Have Skills & Experience

• 4+ years of experience in a Data Engineer role within a cloud-native ecosystem.
• Experience with Snowflake for data warehousing and analytics.
• Proficiency in Python for functional programming and data scripting.
• Working knowledge of DBT (data build tool) for data transformation within the warehouse.
• Experience with Matillion or similar ETL/ELT tools such as SSIS or Informatica.
• Advanced SQL skills, with experience in both Relational SQL (MySQL, Postgres) and NoSQL databases (DynamoDB, Cassandra).
• Hands-on experience with AWS Cloud data services.
• Proficiency with Big Data tools such as Spark, ElasticSearch, Kafka, or Kinesis.
• Strong background in building and optimizing "big data" pipelines, architectures, and data sets.
• Knowledge of stream processing, message queuing, and highly scalable data stores.
• Experience supporting external customers and working in a dynamic environment.
• Excellent communication and presentation skills, with the ability to articulate complex concepts clearly.
• A collaborative team player who is eager to both train others and learn from the team.
• Bachelor’s degree (Graduate preferred) in Computer Science, Mathematics, Informatics, Information Systems, or a related quantitative field.

Nice-to-Have Skills

• Ability to integrate and leverage Large Language Models (LLMs).
• Knowledge of RAG (Retrieval-Augmented Generation) frameworks.
• Experience with ML models for classification, scoring, and predictive analytics.
• Experience with Deep Learning Neural Networks, including Convolutional and NLP models.

Why work for us? 

Our team inspires progress in each other and in our customers through our relentless pursuit of excellence; you will work with leaders who promote learning and personal development. We offer competitive salaries, bonus incentives, benefits, flexible hours, and mentoring. Apply now to become part of the team. 

AllCloud is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, provincial, or local law.