1001 Freelance Projects
Latest Projects from Freelance Marketplaces
Today is: 21-Jan-2026 01:33 GMT
View Project
View this project in detail (Note: you will be redirected to external marketplace)
Project title: Senior Node/Postgres Engineer for Ingestion & Analytics Pipeline
Posted by: External project from PeoplePerHour
Started: 29-Dec-2025 04:33 GMT
Description: Project Overview
We are building a Next.js + Node.js + Vercel analytics SaaS for affiliates. Users connect affiliate networks via API or CSV upload, we normalise performance stats, and we provide dashboards, GEO heatmaps, anonymised and aggregated network benchmarks, and alerts.

The core challenge (and priority) is building a clean, reliable data ingestion and aggregation system that scales as more users and networks connect.

What You’ll Work On
You will lead the backend/data engineering work for ingestion and analytics, including:

- Design the data model in Postgres for raw imports, normalised metrics, and aggregated reporting
- Build API integrations (auth where needed, scheduled pulls, pagination, rate limits)
- Build a CSV import pipeline (validation, mapping, deduplication, error handling, audit trail)
- Implement background jobs for ingestion and processing (cron plus queues/workers) with retries, backoff, and idempotency
- Build the aggregation layer for dashboards/heatmaps and anonymised benchmarks (privacy-safe rules for small sample sizes)
- Expose clean API endpoints for the Next.js app (performance focused)
- Add logging/monitoring and basic automated tests for pipeline reliability
- Ensure sensible handling of sensitive data (secrets, access tokens, and user isolation)

Current Stack / Preferences

- Next.js (App Router) + Node.js runtime
- Vercel deployment
- Postgres (hosted provider is flexible)
- ORM: Prisma or Drizzle (open to your recommendation)
- Background jobs: cron + queue/worker approach (open to your recommendation)

Required Experience (Must Have)

- Strong Node.js/TypeScript backend experience (production SaaS preferred)
- Deep Postgres skills (schema design, indexing, query optimisation, migrations)
- Real background job experience (queues/workers, cron scheduling, retries, idempotency)
- Proven experience integrating third-party APIs and handling messy/partial data
- Ability to design systems that are clean, organised, and maintainable

Nice to Have

- Experience deploying Node/Next.js systems on Vercel or serverless environments
- Experience building analytics/aggregation systems (materialized views, rollups, caching strategies)
- Familiarity with privacy-safe aggregation (minimum sample thresholds, anonymisation rules)
- Experience with affiliate platforms, iGaming, or performance marketing analytics
- Observability tooling (Sentry, OpenTelemetry, structured logging)

Engagement

- Contract role (remote)
- Start with an initial scope focused on ingestion + aggregation MVP, with potential for ongoing work
- Please confirm you are comfortable with the milestone-based budget and timeline below
- Deliverables are defined by the milestone acceptance criteria below

What Success Looks Like (Deliverables)

- Clear backend architecture for ingestion, processing, and aggregation
- Working pipeline for CSV import and at least one API integration (with a pattern to add more)
- Normalised metric layer (consistent definitions across sources)
- Aggregated tables/endpoints powering dashboards + GEO heatmap
- Foundation for anonymised benchmark calculations
- Clean code structure, basic tests, and logging

How to Apply
Please send:

- A short intro and 1–3 relevant projects you’ve shipped (links if possible)
- Your preferred stack for Postgres + jobs (Prisma/Drizzle, cron/queues, ETL approach)
- A brief outline of how you would design ingestion + deduplication + retries for API and CSV sources

Screening Questions (Answer briefly)

- Describe a pipeline you built. How did you handle retries, rate limits, and duplicate imports?
- What’s your preferred approach for background jobs in a Next.js/Vercel setup?
- How would you prevent anonymised benchmarks from leaking data in small GEO/brand sample sizes?

We are optimising for correctness and reliability over flashy UI. The data pipeline is the constraint.
Please include one example of a data pipeline you shipped in production and what broke first.

---------------------------------

**See attached PDF for Milestones and detailed project overview**

Budget

- Timeline: Preferably within 3 months (Milestones 1 to 5 delivered on a rolling basis)
- Payment: milestone-based, €1,200 per milestone (5 milestones)
- Total budget: €6,000

Milestone payments are released as milestones are completed and accepted, not strictly one per month.
Some milestones may be delivered in the same month depending on progress.

---------------------------------

Preferred applicants: Senior backend/data engineers with proven production experience in Node.js/TypeScript, Postgres, and background job systems (data pipelines, ETL, ingestion, rollups).

More ongoing work available after this project for the right candidate.
Project ID: 3463453
Project category:
Project budget:
View this project in detail (Note: you will be redirected to external marketplace)
Last Projects / Browse Projects
  Project Started
Builder.io Website Design Finalization -- 3
Category: CSS, Design Optimization, Figma, Frontend Development, Graphic Design, JavaScript, UI / User Interface, Web Application, Web Design, Web Development
Budget: min $50 USD
20-Jan-2026
23:02 GMT
looking for a lawyer in chittagong to deal a family case
Category: Conflict Resolution, Contracts, Data Entry, Family Law, Legal, Legal Consultation, Legal Research, Legal Writing, Virtual Assistant
Budget: $10 - $30 USD
20-Jan-2026
23:02 GMT
Spanish Short Stories Translation -- 2
Category: Castilian Spanish Translator, Creative Writing, Editing, English (US) Translator, English Translation, Language Tutoring, Spanish Translator, Translation
Budget: $30 - $60 NZD
20-Jan-2026
23:00 GMT
Luxury Leather Clutch Design
Category: 3D Rendering, Concept Design, Creative Design, Design Thinking, Fashion Design, Logo Design, Product Design, Prototype Design, Sketching, Textile Design
Budget: £20 - £250 GBP
20-Jan-2026
23:00 GMT
Optimizar web y SEO despacho
Category: Content Strategy, Google Analytics, Internet Marketing, Link Building, Marketing, Website Optimization, WordPress
Budget: €30 - €250 EUR
20-Jan-2026
23:00 GMT
Spanish Short Stories Translation
Category: Castilian Spanish Translator, Creative Writing, Editing, English (US) Translator, English Translation, Language Tutoring, Spanish Translator, Translation
Budget: $30 - $60 NZD
20-Jan-2026
23:00 GMT
WhatsApp Chatbot & Monday Tasks
Category: API Integration, Automation, Chatbot, Flask, Monday.com, Node.js, OpenAI, Twilio
Budget: $10 - $30 USD
20-Jan-2026
22:59 GMT
Youth Basketball Highlight Reel
Category: Adobe Premiere Pro, After Effects, DaVinci Resolve, Final Cut Pro, Video Editing, Video Post Editing, Video Processing, Video Production, Video Services, Videography
Budget: $30 - $250 USD
20-Jan-2026
22:59 GMT
Python Licensing Tax Automation Script
Category: Data Analysis, Data Integration, Data Processing, Database Programming, Python, Software Architecture, SQL
Budget: $15 - $25 USD
20-Jan-2026
22:54 GMT
Business Plan PowerPoint Creation
Category: Business Plan Writing, Content Development, Content Strategy, Data Visualization, Graphic Design, Powerpoint, Presentations
Budget: $250 - $750 NZD
20-Jan-2026
22:53 GMT
24-Hour PowerPoint Polish
Category: Adobe Creative Suite, Adobe Illustrator, Adobe InDesign, Photoshop, Graphic Design, Powerpoint, Typography
Budget: $30 - $250 USD
20-Jan-2026
22:52 GMT
Remote Permanent Social Media Reels Editor
Category: Adobe Premiere Pro, Content Creation, Video Ads, Video Editing, Video Post Editing, Video Processing, Video Production, Video Services
Budget: ₹600 - ₹1000 INR
20-Jan-2026
22:52 GMT
AI Agency Rev-Share Partnership
Category: AI Consulting, AI Development, Automation, Business Development, Graphic Design, HTML, Illustration, PHP
Budget: $250 - $750 CAD
20-Jan-2026
22:50 GMT
Google Rezensionen
Category: Google Adwords, Google Chrome
Budget: €30 - €250 EUR
20-Jan-2026
22:49 GMT
LinkedIn Lead Generation Boost
Category: B2B Marketing, Content Marketing, Digital Marketing, Email Marketing, Lead Generation, Market Research, Sales, Social Media Marketing
Budget: £250 - £750 GBP
20-Jan-2026
22:49 GMT
Browse All Projects
Projects by Skills ...
Projects for 'android'
Projects for 'ajax'
Projects for 'asp'
Projects for 'aspnet'
Projects for 'cms'
Projects for 'cpp'
Projects for 'csharp'
Projects for 'css'
Projects for 'delphi'
Projects for 'design'
Projects for 'drupal'
Projects for 'excel'
Projects for 'facebook'
Projects for 'flash'
Projects for 'html'
Projects for 'java'
Projects for 'javascript'
Projects for 'joomla'
Projects for 'iphone'
Projects for 'mysql'
Projects for 'photoshop'
Projects for 'php'
Projects for 'python'
Projects for 'ruby'
Projects for 'seo'
Projects for 'sql'
Projects for 'sysadm'
Projects for 'translate'
Projects for 'typing'
Projects for 'twitter'
Projects for 'vbnet'
Projects for 'xml'
Projects for 'wordpress'
Projects for 'writing'
Read RSS feeds ... New!
RSS feed for 'android'
RSS feed for 'ajax'
RSS feed for 'asp'
RSS feed for 'aspnet'
RSS feed for 'cms'
RSS feed for 'cpp'
RSS feed for 'csharp'
RSS feed for 'css'
RSS feed for 'delphi'
RSS feed for 'design'
RSS feed for 'drupal'
RSS feed for 'excel'
RSS feed for 'facebook'
RSS feed for 'flash'
RSS feed for 'html'
RSS feed for 'java'
RSS feed for 'javascript'
RSS feed for 'joomla'
RSS feed for 'iphone'
RSS feed for 'mysql'
RSS feed for 'photoshop'
RSS feed for 'php'
RSS feed for 'python'
RSS feed for 'ruby'
RSS feed for 'seo'
RSS feed for 'sql'
RSS feed for 'sysadm'
RSS feed for 'translate'
RSS feed for 'typing'
RSS feed for 'twitter'
RSS feed for 'vbnet'
RSS feed for 'xml'
RSS feed for 'wordpress'
RSS feed for 'writing'
New!
Проекты на русском
(Projects in Russian)

Long URL:
www.1001freelanceprojects.com
Mobile version:
m.1001fp.com
Copyright © 2005-2025 1001 Freelance Projects