Job Description: Big Data Engineer Summary We are looking for an experienced Big Data Engineer with 7–10 years of hands-on experience to design, build, and maintain scalable data pipelines and processing systems in an on…
Pittsburgh, Pennsylvania, United States · Remote OK
$82k–$139k/yr
Senior$4.0B raised
As the Senior Developer - Software Tester, you will be responsible for contributing measurable values to enable the software development team to deliver new and enhanced features to our customers. You will be accountable…
Title: Data Architect Reports To: Director - Data Engineering Location: Pittsburgh, PA or New York, NY American Eagle is a youth culture brand grounded in denim. Our purpose extends beyond making the best jeans–we embrac…
Skills: Data architecture, Google Cloud Platform, BigQuery, ETL/ELT, Data modeling
Title: Principal Engineer - UI Reports To: Director of Engineering Location: Pittsburgh, PA About American Eagle American Eagle is a youth culture brand grounded in denim. Our purpose extends beyond making the best jeans…
Title: Engineer - Observability & Monitoring Reports To: Associate Manager - Engineering Location: Pittsburgh, PA American Eagle is a youth culture brand grounded in denim. Our purpose extends beyond making the best jean…
Skills: Monitoring, Observability, New Relic, Splunk, Elastic
Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to …
Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to …
Skills: Product Strategy, Business Strategy, Digital Banking, Fintech, Customer Insights
What We Do Gecko Robotics is helping the world’s most important organizations ensure the availability, reliability, and sustainability of critical infrastructure. Gecko's complete and connected solutions combine wall-cli…
Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to …
Position Overview At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering the best experience for our customers. We work together each day to …
Skills: Java, API design, Software development, Backend services, Technical design
What We Do Gecko Robotics is helping the world’s most important organizations ensure the availability, reliability, and sustainability of critical infrastructure. Gecko's complete and connected solutions combine wall-cli…
Skills: Enterprise security engineering, Endpoint management, Endpoint detection and response, Identity and access management, SaaS governance
Voyager is an innovative space, defense, and national security technology company committed to advancing and delivering transformative, mission-critical solutions. We tackle the most complex challenges to unlock new fron…
Skills: Software testing, Integration testing, Python, Object-oriented programming, Test automation
UPMC is hiring a Systems Analyst-Tech Lead (Epic Willow)! We are targeting people with Retail Pharmacy experience, please make sure this is clearly outlined in your resume! This opportunity offers the ability to gain exp…
Skills: Epic Willow, Retail Pharmacy, System Integration, Workflow Analysis, Technical Support
JOB SUMMARY: The IT Product Owner III will function as the key liaison between business, technology, and technical vendors. This role will be responsible for communicating across teams to understand ATC needs and opportu…
About us TeleTracking began with a simple but powerful belief that no one should wait for the care they need. More than a slogan, it’s a promise to continually improve healthcare. TeleTracking builds groundbreaking techn…
Skills: Distributed systems, Cloud-native platforms, Microservices, API design, Event-driven architecture
Pittsburgh, Pennsylvania, United States · Remote OK
Entry level$175M raised
Company Description Air is the leader in Enterprise Readiness. Our mission is to establish readiness as a real-time condition that is continuously achieved. Today, a dangerous Readiness Gap exists between what the front …
Skills: SQL, Java, Typescript, React, Front-end Development
Vice President, Production Support Analyst-AI Adoption-Liquidity & Margin Service Platform
Pittsburgh, Pennsylvania, United States · On-site
$69k–$153k/yr
Senior$3.9B raised
Vice President, Production Support Analyst-AI Adoption-Liquidity & Margin Service Platform At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial …
Skills: Production support, Incident management, Problem management, Change management, ServiceNow
Date/Time: Monday, September 14 from 5-6:30pm Location: Will be sent to confirmed attendees closer to the date Come join MW engineers for a hands-on systems design workshop! We'll present a real problem we've faced at Ma…
Skills: Systems design, Problem solving, Engineering, Technical collaboration
Senior Engineering Manager, ML Infrastructure for Ads Safety
Pittsburgh, Pennsylvania, United States · On-site
$262k–$364k/yr
Senior+$26M raised
Minimum qualifications: Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience. 8 years of technical leadership and people management experience, including in leading manager…
Skills: Machine Learning Infrastructure, Technical Leadership, People Management, Software Development, Distributed Systems
What you'll be doing: Lead the design, development, and integration of complex electrical and mechanical systems for autonomous vehicles, ensuring they meet rigorous performance, safety, and reliability standards. Archit…
Skills: Vehicle integration, Electrical systems, Mechanical systems, Automotive ethernet, CAN
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
$100k–$130k/yr
Full-time
Posted 5d ago
~40 hrs/week
Responsibilities
The Big Data Engineer will design, build, and maintain scalable data pipelines and processing systems within an on-premises Hadoop environment. They will also provide technical leadership by mentoring team members and defining architectural standards for data solutions.
Requirements
Candidates must have 7–10 years of experience in data engineering with deep expertise in Python, the Hadoop ecosystem, and Apache Spark. Strong skills in technical leadership, architectural design, and enterprise job orchestration tools like CA7 or Control-M are required.
Full job description
Job Description: Big Data Engineer Summary
We are looking for an experienced Big Data Engineer with 7–10 years of hands-on experience to design, build, and maintain scalable data pipelines and processing systems in an on-premises Big Data environment. Beyond strong individual contribution, the ideal candidate will own architecture and design decisions, set technical direction, and mentor and support other developers on the team. The role works closely with cross-functional teams to deliver reliable, high-quality data solutions that support business and analytics needs.
Roles & Responsibilities
Lead the design, development, and maintenance of robust, scalable data pipelines for ingestion, transformation, and processing of large datasets in an on-premises environment.
Own architectural and design decisions for data solutions, evaluating trade-offs and defining technical standards for the team.
Mentor, guide, and support other data engineers through code reviews, design reviews, technical coaching, and hands-on problem-solving.
Build and optimize data workflows using Python, Spark, and the Hadoop ecosystem.
Work extensively with Hadoop ecosystem components (Hive, HDFS, Impala) to manage and query large-scale data.
Manage and optimize batch scheduling and job orchestration using enterprise schedulers such as CA7 or Control-M.
Ensure data quality, integrity, and performance across data platforms.
Collaborate with data analysts, data scientists, and business stakeholders to translate data requirements into sound technical designs.
Troubleshoot and resolve complex issues in data pipelines and production environments, acting as an escalation point for the team.
Champion best practices for coding standards, version control, testing, and documentation.
Stay current with emerging technologies, particularly AI/ML capabilities, and identify opportunities to apply them to data engineering workflows.
Technical Skills Must Have
7–10 years of overall experience in data engineering, with a proven track record in technical leadership (design ownership, mentoring, guiding development teams).
Python – strong hands-on development experience building production-grade data solutions.
Big Data / Hadoop ecosystem (Hadoop, Hive, Impala, HDFS) – deep, hands-on experience in on-premises environments.
Apache Spark – solid experience developing and tuning large-scale distributed data processing jobs.
Job scheduling / orchestration – hands-on experience with CA7 or Control-M (or comparable enterprise schedulers).
Strong understanding of data structures, ETL processes, and SQL.
Extensive experience with large-scale data processing and distributed systems.
Demonstrated ability to make sound architecture/design decisions and to mentor and support other developers.
Exposure to AI/ML concepts or tools, with a strong willingness to learn and grow in this space.
EXL (NASDAQ: EXLS) is a leading data analytics and digital operations and solutions company. We partner with clients using a data and AI-led approach to reinvent business models, drive better business outcomes and unlock growth with speed. EXL harnesses the power of data, analytics, AI, and deep industry knowledge to transform operations for the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 54,000 employees spanning six continents. For more information, visit www.exlservice.com.
EXL never requires or asks for fees/payments or credit card or bank details during any phase of the recruitment or hiring process and has not authorized any agencies or partners to collect any fee or payment from prospective candidates. EXL will only extend a job offer after a candidate has gone through a formal interview process with members of EXL’s Human Resources team, as well as our hiring managers.
EXL is the indispensable partner for leading businesses in data-led industries such as insurance, banking and financial services, healthcare, retail and logistics. We bring a unique combination of data, advanced analytics, digital technology and industry expertise to help our clients turn data into insights, streamline operations, improve customer experience, and transform their business. Our partnerships with clients are built on a foundation of collaboration – and we’ve been chosen as a partner by nine of the top ten leading US insurance companies, nine of the top 20 global banks, and six of the top ten US health care payers. We function as one team to make your goals our goals, whether that’s unlocking the value of generative AI or embedding analytics into workflows that reduce risk or power your growth. Clients choose EXL as their transformation partner for many reasons. Our geographic diversity make talent all over the world instantly accessible. Digital accelerators enable unmatched speed-to-value, letting you realize results fast. It’s our people that truly set us apart, though, including the 1,500 data scientists we have dedicated to our generative AI practice. And our more than twenty years of experience in delivering business services, garnering stellar client references, and maintaining a solid balance sheet are reassuring to our C-suite clients. Find out for yourself why clients, employees, and analysts think we’re some of the best in the business. Contact us to see how we can help you achieve your goals.
Related keywords
Big DataData EngineeringPythonHadoopSparkHiveImpalaHDFSETLSQLData PipelinesCA7Control-MAIMLDistributed Systems
Choosing a digital partner is about more than capabilities — it’s about collaboration and character.
Unrealistic overhauls and off-the-shelf products ignore what matters most — your unique needs, culture, goals, and your legacy data and technology environments.
At EXL, our collaboration is built on ongoing listening and learning to adapt our methodologies. We’re your business evolution partner—tailoring solutions that make the most of data to make better business decisions and drive more intelligence into your increasingly digital operations.
Whether your goals are scaling the use of AI and digital, redesign operating models, or driving better and faster decisions, we’re here to partner with you to help you gain—and maintain—competitive advantage with efficient, sustainable models at scale.
Our expertise in transformation, data science, and change management helps make your business more efficient and effective, improve customer relationships and enhance revenue growth. Instead of focusing on multi-year, resource- and time-intensive platform designs or migrations, we look deeper at your entire value chain to integrate strategies with impact.
We use our specialization in analytics, digital interventions, and operations management—alongside deep industry expertise — to deliver solutions that help you outperform the competition.
At EXL, it’s all about outcomes—your outcomes—and delivering success on your terms. Share your goals with us and together, we’ll optimize how you leverage data to drive your business forward.
For more information, visit www.exlservice.com.
Offices: 320 Park Avenue, 29th Floor, New York, NY 10022, US · 10 Exchange Pl, Jersey City, NJ 07302, US
Operations ManagementDecision AnalyticsTechnology PlatformsHealthcareFinance & AccountingInsuranceRisk & Financial ManagementTravelTransportation and logisticsBanking and Financial Services
Based on 242 listings with disclosed salaries, most software jobs in Pittsburgh, PA pay between $71k–$200k per year. Individual offers vary with seniority, company size, and specialization.
How many Software jobs are open in Pittsburgh, PA right now?
There are currently 522 open software positions in Pittsburgh, PA listed on Clera. New openings are added daily as companies post roles.
Which companies are hiring for Software roles in Pittsburgh, PA?
Companies currently hiring include PNC, Carnegie Mellon University - School of Computer Science - Language Technologies Institute, BNY, Net Health, Software Engineering Institute | Carnegie Mellon University, among others. Browse the listings above to see every active employer.
Are there remote or hybrid Software jobs in Pittsburgh, PA?
Yes — 242 of the 522 open software positions offer remote or hybrid work (102 remote, 140 hybrid).
How do I apply for Software jobs in Pittsburgh, PA?
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.