About this role
Skills & Experience
• Bachelor’s Degree in Computer Science or Engineering with 3-5 years of experience in Azure Data engineering, Python, Pyspark or Big Data development
• Sound Knowledge of Azure Synapse analytics for pipelines, orchestration, set up
• 1-2 experience in Visualization design and development with Power BI. Knowledge on row-level security, access control
• Sound experience in SQL, Datawarehouse, data marts, data ingestion with Pyspark and Python
• Expertise in developing and maintaining ETL processing pipelines in cloud-based platforms such as AWS, Azure, etc. (Azure Synapse or data factory preferred)
• Team player with good interpersonal, communication, and problem-solving skills.
Job Scope
• Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration
• Designing and developing reports and dashboards in Power BI, setting up access control with row-level security, DAX query experience
• Establishing connections to source data systems, including company internal systems e.g. SAP, Historians, Data Lake, etc. as well as external systems such as Web APIs, etc
• Managing the collected data in appropriate storage/data-base solutions e.g. file systems, SQL servers, Big Data platforms such as Hadoop, HANA, etc. as required by the specific project requirements
• Design, development of data marts and relevant data pipelines using pyspark, data copy activities for batch ingestion
• Deployment of pipeline artifacts from one environment to the other using Azure Devops
• Performing data integration e.g. using database table joins, or other mechanisms at an appropriate level as required by the analysis requirements of the project.
Good to have
• Data catalog with Purview enabling effective metadata management, lineage tracking, and data discovery
• Candidates should demonstrate the ability to leverage Purview to ensure data governance, compliance, and efficient data exploration within Azure environments.
Others
• Able to work independently on assignment according to agreed schedule without much supervision
• Own assignment and take initiative to resolve issues hinder completion of assignment Proactively reach out for help/guidance whenever required.
Other facts
About Flintex Consulting Pte Ltd
EA License # 17C8724
UEN # 201716889C
Latest Job Opportunities at Flintex Consulting - https://flintex.com.sg/jobs/
Welcome to Flintex Consulting, a leading Recruitment Agency in Singapore.
We Match We Guide We Place
We specialize in Technology, BFSI, Human Resource & Administration, Engineering & Manufacturing, Sales & Marketing,Finance & Accounting sectors.
We cater to the needs of a) individual job candidates and b) companies seeking for the right employees to drive their business.
We have been able to construe and bridge the needs and demands of our individual and corporate clients. Our wide industry expertise and select client base enable us to foster fruitful careers rather than short-term jobs and placements.Our advanced placement platform is designed to match employee skill sets with current vacancies with perfect accuracy. We utilize an efficient, systematic and ultra-precise recruitment method that surpasses industry standards.
Flintex Consulting has been successful in collaborating multiple leading employers, vendors and clients. We also offer valuable insight to candidates and companies to maximize their recruitment efforts. Candidates are mentored towards finding the best-fit jobs to help build successful careers.We cover all levels of placement, from entry level professionals to mid-level and CEO level posts.We promise to provide the best suited jobs through our research-based methodologies merged with our top qualified personnel.
Flintex Consulting promises to grow your career the right way. Whether you are a client or a candidate, we have a streamlined platform to match your needs efficiently.
Specialties:
IT Recruitments, Staff Augmentation, Contract Staffing, Salary Advisory, Temporary Hiring, Executive Search, Project based Search, RPO, Payroll Services, Work Pass Application, Leadership Hiring and Training's.
What you'll do
- The role involves designing, reviewing, and developing Pyspark scripts, as well as testing and troubleshooting data pipelines. Additionally, the engineer will design and develop reports and dashboards in Power BI and manage data connections to various source systems.
Ready to join Flintex Consulting Pte Ltd?
Take the next step in your career journey