Shafay A.

About Shafay

Experience

1. O

   Orion S.A. · Full-time

   • Lead Data Engineer

     Feb 2024 - Present · 1 yr 8 mos·Berlin, Germany · Remote·Current

     Built a scalable data platform using AWS, Serverless, Snowflake, and AWS Specific tools such as Lambda, Glue, S3, LakeFormation, Data Zones, enabling centralized analytics for manufacturing, operations, and finance teams. Led design and orchestration of end-to-end data pipelines with DBT and Airflow, including metadatadriven architecture for data governance and lifecycle management. Collaborated cross-functionally with data scientists, analysts, and engineering teams to align data infrastructure with business priorities and compliance standards. Enabled ML & GenAI initiatives by integrating Amazon Bedrock, LangChain, and Streamlit to deploy LLMpowered AI agents and Q&A chatbots for internal automation. Optimized analytics use cases across supply chain and production workflows, directly contributing to increased revenue through improved real-time insights. Key Tech: AWS (Lambda, Redshift, Glue, ECS, EKS, Bedrock, Q Business), Python, SQL, DBT, Terraform, Kubernetes, Airflow, Streamlit, HuggingFace, Diffusion Models.

2. D

   Delivery Hero · Full-time

   • Senior Data Engineer

     Jan 2022 - Jan 2024 · 2 yrs 1 mo·Berlin, Germany · On-site

     I have experience in managing and developing data pipelines within cloud services, specifically AWS and GCP. My role includes actively monitoring these pipelines using management tools like Airflow. Additionally, I have expertise in implementing secure and scalable API endpoints to provide access to the processed data. As part of my responsibilities, I take a proactive approach to enhance our infrastructure by suggesting, experimenting with, and adopting new tools and technologies. I am committed to embracing development best practices and ensuring code quality by mentoring junior team members. Furthermore, I believe in the importance of knowledge sharing within the organization, whether it's within the team, across the company, or with stakeholders. My ultimate aim is to enhance marketing efficiency by automating decision-making processes and reporting. I focus on achieving campaign and acquisition cost metrics, specifically with respect to CPA, which has resulted in generating millions of Euros at various levels. Some of the tools and technologies I'm proficient in include Terraform for Infrastructure as Code (IAC), Google BigQuery, Cloud Functions, VertexAI, Looker, GitHub Actions CI/CD and Airflow, dbt. I have also worked with Docker and Atlantis as part of my infrastructure management and development tasks. Additionally, part of the Hiring/Tech Interview Committee for DeliveryHero Data Engineers/Analysts. GenAI Amazon GenOS/ AWS Bedrock / Amazon Q (preview based) / Amazon OpenSearch Service

3. G

   Goldman Sachs · Part-time

   • Senior Data Engineer

     Jun 2021 - Dec 2021 · 7 mos·London Area, United Kingdom · Remote
4. A

   Amazon · Full-time

   • Senior Data Engineer

     Aug 2020 - Dec 2021 · 1 yr 5 mos·Seattle, Washington, United States · Remote

     Work in a cross-functional team of engineers and data scientists focused on improving the efficiency of the marketing activities. Create new products to measure the impact of campaigns across different channels. Develop a new data-science-backed solution to optimize the spending of our marketing budget. Improve the existing models and data products owned by the squad such as marketing attribution, online & offline measurement, customer lifetime value, media mix models, and more. Create data pipelines in an environment with VMs and Cloud services (AWS and GCP). Proactively improve our infrastructure, suggesting, trying and adopting new tools. Embrace development best practices and ensure code quality. Share your work and knowledge at many levels (team, company, stakeholders). All this with the goal to increase the marketing efficiency with automated decisions and reporting. Tech Stack: python3 (+ data packages, e.g. pandas), SQL and NoSQL, Airflow, Docker, Terraform, Spark AWS, and Google Cloud services. Use predictive modeling to increase and optimize customer experiences, revenue generation, ad targeting, and other business outcomes.  Implements data structures using best practices in data modeling, processes, and technologies.  Designs develop and tests BI solutions such as databases, data warehouses, queries and views, reports, and dashboards.  Performs data conversions, imports, and exports of data within and between internal and external software systems.  Merges BI platforms with enterprise systems and applications.  Enhances the performance of business intelligence tools by defining data to filter and index.  Documents new and existing models, solutions, and implementations. Workflows, Glue Jobs, ETL automation, Data Migrations, Dashboard Manipulation, Machine learning Analytics, AWS Services, Algorithmic Intelligence. Through Makeen

5. F

   Full-time · 2 yrs 10 mos

   • Data Scientist

     Mar 2020 - Aug 2020 · 6 mos
   • Machine Learning Engineer

     Apr 2019 - Feb 2020 · 11 mos
   • Software Development Engineer II

     Feb 2019 - Jan 2020 · 1 yr

Education

1. 
   Concordia UniversityMaster's degree, Computer ScienceJun 2021 - Jan 2023

   Activities and societies: contact: [email protected] C01 - Developments in Computer Science C02 - Parallel and Distributed Systems C03 - Image Processing/Pattern Recognition and Graphics C04 - Software Systems and Languages C05 - Information Processing and Management C06 - Scientific Computation and Algorithms C07 - Artificial Intelligence and Human-Machine Communication DROP OUT

2. 
   Government College University (GCU), LahoreBachelor's degree, Computer Science (hons)2013 - 2017

   Grade: A Activities and societies: Programming, sportsmanship hockey, boxing, basketball, gymnastics 3 semesters : 3.6 CGPA + / 4.0 + (post major semesters :after 4th semester) out of total 8 semesters Programming , developer, Helping Juniors, Developing skills , doing Sports. If You think university matters(than you can pick based on my qualification). EchSee cam

Skills