Vortexa was founded to solve the immense information gap that exists in the energy industry.
By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real-time, bringing transparency and efficiency to the energy markets and society as a whole.
The Challenge
Ingesting data from multiple external sources at hundreds of rich data points per second, moving terabytes of data while processing it in real-time, running complex prediction and forecasting AI models, and coupling their output into a hybrid human-machine data refinement process, all while presenting the results through a low-latency SaaS platform used globally, is a significant engineering challenge.
This requires a reliable, stable, fault-tolerant infrastructure capable of withstanding varied use cases by data analysts, scientists, industry experts, and end-users.
Fast product iteration cycles demand a platform that allows engineers to deploy frequently, independently, and without deep infrastructure knowledge.
The Data Services Team manages the developer platform and the AWS infrastructure Vortexa relies on.
This includes ensuring infrastructure availability, security, cost-efficiency, and a seamless developer experience.
Technologies used include Kubernetes, Kubevela, Golang, Kafka, Opensearch, Airflow, Athena, among others.
You will be a key member of a small, globally distributed team, responsible for assessing current technologies, delivering an optimal engineering experience with rapid development cycles, standardizing technology stacks, implementing the infrastructure roadmap, and ensuring 100% uptime, availability, and fault-tolerance of all platform components while optimizing AWS costs.
You will provide developers and data scientists with tooling that boosts productivity and allows focus on business logic.
Additionally, you will automate operational knowledge to enable R&D to focus on creating value for customers.
You Are:
Committed to creating infrastructure that enhances developer experience
Excellent at troubleshooting unfamiliar code
Striving to become an expert in Kubernetes
An AWS power user and evangelist
Familiar with Apache Kafka, including deployment, monitoring, resiliency, and cluster operations
Experienced with ElasticSearch operations
Proficient in Terraform and Go
Knowledgeable about cloud-native application design and deployment
Comfortable with infrastructure troubleshooting and challenges
A proactive can-do person who takes ownership
Nice to Have:
Familiarity with Airflow or similar workflow orchestration tools
Understanding of data lakes like Parquet, Orc, Athena
Benefits:
Stock options in a fast-growing, high-potential company
Diverse and vibrant workplace
Collaborative and merit-based culture that celebrates innovation and execution
Opportunity to work with AI-driven technology in a scale-up environment with commodity trading experts
401k plan with up to 2% matching
Private health insurance via Blue Cross Shield
Dental and vision coverage through Guardian
Global volunteering policy to support social impact
#J-18808-Ljbffr