Senior Data Engineer

<p>At <strong>ioet</strong>, a leading software company with a talented team across LATAM, we provide Software Engineering as a service to clients worldwide. Join us for exciting professional challenges, working on projects ranging from innovative startups to globally recognized brands. Our positions are full-time, remote, and offer competitive compensation in USD.<br></p><p>We are looking for an experienced <strong>Senior Data Engineer</strong> with strong hands-on expertise in <strong>Databricks, PySpark, Python</strong>, and data quality initiatives. You will play a key role in designing and implementing scalable data pipelines, ensuring reliable data processing, and driving data quality across the platform.</p><p>This role also requires solid experience building services and data-driven applications using Python with Django, asynchronous task processing with Celery, caching and messaging tools, and modern databases used for both structured and unstructured data storage.</p><p>You should feel comfortable working with large datasets, optimizing distributed processing jobs, and partnering closely with stakeholders to deliver high-quality, well-structured data products that support both analytics and application-level needs.</p><p>Responsibilities:</p><ul><li>Design, develop, and optimize ETL pipelines using Databricks, PySpark, and Python</li><li>Build and maintain PySpark jobs for large-scale data processing and transformation</li><li>Implement and manage Databricks workflows, Delta Lake operations, and notebook-based development</li><li>Develop Python scripts and reusable components to support data processing and automation</li><li>Build and maintain web services using Python and Django</li><li>Implement asynchronous task processing with Celery</li><li>Use Redis for caching strategies and improving application performance</li><li>Work with RabbitMQ for message queues and event handling</li><li>Ensure data quality, reliability, and documentation across the platform</li><li>Work with PostgreSQL as the primary relational database</li><li>Use MongoDB for metadata and indexing workflows</li><li>Operate Elasticsearch as the main search engine in the platform</li></ul><p><strong>Requirements:</strong></p><ul><li>5+ years working as a Data Engineer<br>Strong professional experience with Databricks (notebooks, jobs, workflows, Delta Lake, etc)</li><li>Advanced hands-on experience with PySpark for batch processing and large-scale data transformations</li><li>Strong Python experience for automation, ETL logic, and data manipulation</li><li>Professional experience using Python with Django</li><li>Experience using Celery for asynchronous tasks</li><li>Experience with Redis for cache and performance optimization</li><li>Experience with RabbitMQ for queues and event-driven workflows</li><li>Proficiency with PostgreSQL as the main database</li><li>Experience working with MongoDB</li><li>Experience implementing Elasticsearch for search and indexing needs</li><li>Experience designing, implementing, and maintaining data quality frameworks, validation checks, and monitoring tools</li><li>Proficiency with SQL for complex transformations and optimization</li><li>Experience working with various stakeholders to understand the data domain and adapt it to business needs</li><li>Strong English communication skills – minimum B2 level</li><li>Send your application and CV in English (mandatory)</li><li>Based in Latin America</li></ul><ul></ul><p><strong>Benefits:</strong></p><ul><li>Remote work</li><li>Flexible schedule</li><li>Collaboration with international clients</li><li>USD compensation</li><li>Paid Holidays and Vacations</li><li>Paid family and&nbsp;sick leaves</li><li>English classes</li><li>Educational and wellness bonus</li><li>Structured career plan with regular salary reviews</li><li>Emphasis on personal growth and mentorship</li></ul><p><strong>Are you ready to be part of the ioet journey?</strong></p><p>Get your <strong>CV in English and Apply Now. </strong></p><p>If you are curious to know more about our culture, technologies, and blogs, visit <a href="www.ioet.com">www.ioet.com</a></p>