Build and own high-throughput Go services that ingest, transform, and route industrial telemetry, optimizing real-time data pipelines for performance, reliability, and production use across cloud and edge environments.
Senior Backend Engineer (Go / AWS Streaming)
📜 Description
- Build and maintain fast, concurrent, well-tested Go services and APIs.
- Own device-to-cloud ingestion through AWS IoT Core, including MQTT connectivity, authentication, routing, and downstream handoff.
- Design and operate Kinesis streaming pipelines, including partitioning, consumers, retries, back-pressure, and dead-letter handling.
- Design Redshift schemas and loading patterns to keep analytics data accurate and queries performant.
- Monitor pipeline reliability, latency, data loss, and AWS costs using dashboards and alerts.
- Lead design discussions, review code, document technical decisions, and mentor engineers.
🛠️ Requirements
- Senior backend engineer: 5+ years of backend engineering experience, with at least 2–3 years writing production Go. You understand goroutines, channels, and the concurrency patterns that hold up under load.
- Streaming in production: You have built and operated streaming data pipelines with AWS Kinesis, or a comparable system such as Kafka, at meaningful scale. You understand ordering, partitioning, exactly-once and at-least-once delivery, and replay.
- AWS IoT or device data: You have worked with AWS IoT Core or another device-telemetry ingestion platform, including MQTT, device authentication, and high-fan-in workloads.
- Data warehouse experience: You have designed and optimized Amazon Redshift, or a similar warehouse such as Snowflake or BigQuery, for production analytics. You write strong SQL and know how to make slow queries fast.
- Cloud and infrastructure: You are strong on AWS (Lambda, S3, IAM, CloudWatch) and comfortable with infrastructure as code such as Terraform or CDK, Docker, and CI/CD.
- Clear communicator: You can explain an architecture trade-off to a US product team in plain English and write design documents people actually read.
Full job description
About us:
Creative Chaos is an AI orchestration company. We help businesses re-engineer how work actually gets done by placing AI orchestrators inside their teams to redesign workflows, deploy agents, and rewire operations end-to-end.
Job Summary:
The Senior Backend Engineer builds the backbone that connects devices in the field to the data that drives decisions. Every event from every endpoint flows through systems you design.
You will build and own high-throughput backend services in Go that ingest device telemetry through AWS IoT and Kinesis, process it in real time, and land it in Redshift for analytics and reporting. Your systems have to handle spikes without losing a single event, scale without anyone stepping in, and stay cheap enough to run at volume.
This is a senior, hands-on engineering role. We are hiring someone who has run streaming pipelines in production, has been paged when they broke, and has made them better every time.
Job Description:
- Build backend services in Go: You design, build, and maintain production Go services and APIs that are fast, concurrent, well tested, and easy for the next engineer to understand.
- Own device ingestion: You build the path from device to cloud on AWS IoT Core, covering device connectivity over MQTT, authentication, message routing, and the rules that hand data off downstream.
- Run real-time streaming pipelines: You design and operate Kinesis Data Streams and Firehose pipelines, with partitioning strategies, consumers, retries, back-pressure, and dead-letter handling. Throughput is high and no data gets lost.
- Model and load the warehouse: You design Redshift schemas, distribution and sort keys, and loading patterns that keep queries fast as data grows. You make sure the data that lands is correct, complete, and ready for analytics.
- Own reliability and cost: You build monitoring, alerting, and dashboards across the pipeline with CloudWatch or similar tools, and you track latency, data loss, and AWS spend. You know the cost per million events and how to bring it down.
- Raise the engineering bar: You lead design discussions, review code, write clear technical documents, and mentor other engineers on the team.
Requirements
- Senior backend engineer: 5+ years of backend engineering experience, with at least 2–3 years writing production Go. You understand goroutines, channels, and the concurrency patterns that hold up under load.
- Streaming in production: You have built and operated streaming data pipelines with AWS Kinesis, or a comparable system such as Kafka, at meaningful scale. You understand ordering, partitioning, exactly-once and at-least-once delivery, and replay.
- AWS IoT or device data: You have worked with AWS IoT Core or another device-telemetry ingestion platform, including MQTT, device authentication, and high-fan-in workloads.
- Data warehouse experience: You have designed and optimized Amazon Redshift, or a similar warehouse such as Snowflake or BigQuery, for production analytics. You write strong SQL and know how to make slow queries fast.
- Cloud and infrastructure: You are strong on AWS (Lambda, S3, IAM, CloudWatch) and comfortable with infrastructure as code such as Terraform or CDK, Docker, and CI/CD.
- Clear communicator: You can explain an architecture trade-off to a US product team in plain English and write design documents people actually read.
Similar jobs
Search more Backend Engineer jobsOwn and develop backend services for an electromagnetic simulation platform, improving APIs, simulation data management, task pipelines, and hybrid cloud and HPC infrastructure.
[Latin America] Senior Software Engineer (Backend)
As a Senior Software Development Engineer, you'll enhance your coding skills while contributing to game development and mentoring junior engineers in a collaborative environment.
[8XS] Senior Software Engineer – Go
Build a scalable Go-based LiveOps plugin platform for game studios, designing plugin contracts and multi-tenant services while integrating Kafka events and setting engineering standards.
Own end-to-end delivery of scalable backend services and distributed data platforms, building Python APIs and data pipelines while improving reliability, performance, and maintainability.
