Expected duration: Ongoing We are seeking a Senior Data Engineer to design, implement, and optimize data pipelines utilizing Scala, Spark, and Java. The ideal candidate will develop and maintain real-time data processing systems essential for business operations. Collaboration with data scientists and analysts is crucial to understand data requirements and deliver high-quality solutions. Responsibilities include ensuring data quality through robust testing, monitoring workflows, and troubleshooting pipelines. Candidates should possess a degree in Computer Science or Engineering, with proven experience in data engineering, real-time processing, and SQL proficiency. Familiarity with cloud platforms and data governance is preferred. We offer a competitive salary, benefits, and opportunities for professional growth in a collaborative environment.
Key Responsibilities:
- Design, implement, and optimize data pipelines using Scala, Spark, and Java. - Develop and maintain real-time data processing systems to support business-critical operations. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. - Ensure data quality and reliability through robust testing and validation procedures. - Monitor and troubleshoot data pipelines and workflows to ensure high availability and performance. - Stay current with emerging technologies and industry best practices to continuously improve our data infrastructure.
Qualifications:
-Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. - Proven experience with Scala, Spark, and Java in a data engineering or similar role. - Strong understanding of real-time data processing and streaming technologies. - Experience with big data platforms and tools such as Hadoop, Kafka, and Flink is a plus. - Proficiency in SQL and experience with relational databases. - Excellent problem-solving skills and attention to detail. - Strong communication and collaboration skills to work effectively with cross-functional teams.
Preferred Skills:
- Experience with cloud platforms (AWS, Azure, Google Cloud) and their data services. - Knowledge of data warehousing solutions and ETL processes. - Familiarity with data governance and security best practices.
Complete Marketing Portal Image Download Category: API Integration, Data Extraction, Data Management, Graphic Design, HTML, PHP, Web Scraping, Web Design Budget: $10 - $50 USD
Christian Book Post Scheduler Category: Analytics, Content Creation, Content Marketing, Digital Marketing, Facebook Marketing, Graphic Design, Social Media Management, Twitter Marketing Budget: $30 - $250 USD
28-Feb-2026 16:58 GMT
Vietnamese Virtual Assistant for Operations Category: Admin Support, Customer Service, Data Entry, Email Handling, English Translation, Excel, Google Sheets, Vietnamese Translator, Virtual Assistant, Web Search Budget: $2 - $8 CAD
28-Feb-2026 16:56 GMT
Rencana Online Shop Fashion Remaja Category: Advertising, Branding, Content Creation, Email Marketing, Influencer Marketing, Logo Design, Market Research, Social Media Marketing, Startup Consulting, Web Design Budget: $750 - $1500 USD
28-Feb-2026 16:55 GMT
Retail Fitness Studio Redesign Category: Architecture, Building Design, Building Engineering, Construction Management, Floor Plan, Graphic Design, Interior Design, Logo Design, User Interface / IA, Web Design Budget: $30 - $250 USD
28-Feb-2026 16:54 GMT
Deskripsi Laporan Keuangan Akurat Category: Accounting, Business Analysis, Business Consulting, Business Writing, Data Analysis, Financial Analysis, Financial Consulting, Report Writing Budget: $250 - $750 USD
28-Feb-2026 16:51 GMT
Goethe A2/B1 Writing Videos Category: Content Creation, Education & Tutoring, German Tutoring, Instructional Design, Online Writing, Teaching / Lecturing, Video Editing, Video Production Budget: ₹1500 - ₹12500 INR
28-Feb-2026 16:51 GMT
Fast-Paced Reels Editing Category: Adobe Premiere Pro, Audio Editing, Color Grading, Final Cut Pro, Sound Design, Video Editing, Video Post Editing, Video Production, Video Services, Visual Effects Budget: ₹600 - ₹1500 INR
