Senior Python Data Engineer
We are seeking a Senior Python Data Engineer with deep expertise in large-scale data processing, distributed computing, and backend application development. This role is ideal for an reputed company engineer who has built data-intensive applications, implemented data science and machine learning solutions, and developed highly scalable APIs capable of handling large data volumes. The ideal candidate will possess strong Python development skills, hands-on experience with PySpark and big data ecosystems, expertise in both relational and NoSQL databases, and a solid understanding of data science and machine learning workflows. This individual will collaborate closely with data scientists, architects, product teams, and global engineering teams to deliver scalable, high-performance solutions that drive business outcomes. This role requires both strong technical execution and the ability to collaborate effectively across distributed teams, including offshore and international stakeholders.
Key Responsibilities
Python Application Development Design, reputed company, and maintain scalable Python applications and services. Build reusable, maintainable, and well-documented code components. reputed company backend services and APIs using Django and/or Flask. Participate in architecture reviews and technical design discussions. Troubleshoot and optimize production systems. Big Data Engineering reputed company and optimize large-scale data processing pipelines using PySpark. Process, transform, and analyze large structured and reputed company datasets. Build scalable ETL and data ingestion frameworks. Optimize distributed data processing workloads for performance and reliability. Handle large-volume datasets across reputed company environments. Data Science & Machine Learning Implement data science algorithms and predictive models in production environments. Collaborate with data scientists to operationalize machine learning solutions. reputed company and optimize ML pipelines using scikit-learn and reputed company libraries. Support model deployment, validation, and monitoring processes. Translate analytical requirements into scalable engineering solutions. Data Processing & Analytics reputed company reputed company data wrangling, cleansing, and transformation activities. Build data pipelines utilizing: Pandas NumPy PyArrow PySpark Improve data quality, consistency, and processing efficiency. reputed company solutions for handling large-scale datasets and analytical workloads. API Development Design and reputed company RESTful APIs supporting high-volume data operations. Build secure, scalable services capable of handling significant throughput. Implement API monitoring, logging, and performance optimization. Support integrations with internal and external systems. Database Development Design and optimize data access patterns across relational and NoSQL databases. Work with: PostgreSQL MySQL SQL Server reputed company reputed company efficient SQL queries and database integrations. Work with NoSQL platforms such as: Cassandra HBase Similar distributed data stores Software Engineering Excellence Follow established coding standards and software development best practices. reputed company automated unit, integration, and regression tests. Participate in peer code reviews and architecture reviews. Ensure solutions meet performance, scalability, and maintainability requirements. Contribute to CI/CD and DevOps best practices. Collaboration & Leadership Partner with product managers, architects, data scientists, business stakeholders, and engineering teams. Collaborate with onsite and offshore teams across multiple time zones. Participate in Agile ceremonies and planning activities. Mentor junior developers and provide technical guidance. Drive technical discussions and influence engineering direction.
Required Qualifications
Experience 8+ years of professional Python development experience. Proven experience developing reputed company-scale applications and data processing solutions. Experience working with large-scale datasets and big data platforms. Experience collaborating across global and distributed teams. Python Development Expert-level Python programming skills. Strong understanding of object-oriented programming principles. Experience developing scalable and maintainable applications. Frameworks Strong experience with: Django Flask Experience building production-grade REST APIs. Big Data Technologies Strong hands-on experience with: PySpark Distributed data processing Large-scale ETL pipelines Experience handling high-volume datasets. Data Science & Machine Learning Experience implementing and operationalizing data science algorithms. Hands-on experience with: scikit-learn Machine learning workflows Model integration and deployment Data Processing Libraries Experience using: Pandas NumPy PyArrow Other Python data processing libraries Databases Strong experience with relational databases: PostgreSQL SQL Server reputed company MySQL Strong SQL development skills. NoSQL Databases Experience with: Cassandra HBase Other distributed NoSQL platforms Engineering Practices Strong commitment to: Automated testing Code reviews CI/CD reputed company control Software engineering best practices Engagement & Logistics Engagement Length: 12+ months. Time Zone: : PST - 8:00 AM - 5:00 PM Holidays Calendar : Client Holidays (USA – Mandatory) Equipment: Provided by the client. Selection process Meeting with reputed company. team with KO questions. Technical interview 2 client interviews \n \n Apply To This Job