Data Engineer
Cloudsmith
Data Engineer
Are you ready to play a central role in the design and implementation of a best-in-class data platform on AWS? Do you have a good understanding of data engineering principles and a passion for creating scalable, efficient, and secure data solutions? If you're seeking a challenging and rewarding role, join Cloudsmith as a Data Engineer!
We help our customers manage and secure their software supply chain, and improve their developer experience. We are by developers, for developers. Our culture operates with openness and transparency, driven by our ambition to build a great company. We enjoy working with great people and customers. We learn, support one another, and we’re growing. Now is a great time to join us.
The Opportunity that lies ahead
As a Data Engineer, you will be at the heart of developing the data platform that serves customer needs - both internal and external. This platform is critical to our business strategy and serves as the backbone for providing insights to customers to help improve their software supply chain, and will serve as the foundation for AI-powered features that leverage our large amounts of static and event data across all of our customers’ build usage.
Our Technology Stack
We are cloud-native, born in AWS, and embrace their services across our platform. Our technology stack includes Python, Django, ECS, Postgres, Kinesis, Cloudfront, Flink, DBT, Elastic Search, Lambda, Amazonmq, Terraform, Postgres & Clickhouse. Tooling includes VS Code, Datadog, Cloudwatch, Sentry, Locust, Slack, Linear, Datadog, Notion and CircleCI.
Our Team
We are four squads responsible for building application capabilities and the underlying platform upon which Cloudsmith is founded. We operate in a highly collaborative environment, where people with different skills come together to make things happen. We have a modern approach to CI/CD, deploying several times per day, and we support a global set of customers who are engineers like us.
Your Role:
Design and Development: Participate in the design and development of our data platform. You will work with other talented data engineers to build scalable, maintainable and efficient data pipelines.
Collaborate with Cross-Functional Teams: Work closely with data engineers, software engineers, and business stakeholders to ensure the platform meets business needs and integrates seamlessly with other systems.
Innovation and Continuous Improvement: Stay abreast of the latest developments in data engineering and AWS technologies. Drive innovation and continuous improvement in our data practices.
Signs you may be a great fit:
We realise that not everyone will have every experience and expertise in every possible thing. Still, if you have many of the following, we might be a great place where you can have high impact and progress your career.
Experience in Data Engineering: Proven track record in designing and building large-scale data platforms, particularly on AWS.
Expertise in Data Technologies: Knowledge of AWS and other services related to data engineering (e.g. S3, Glue, DBT, Lambda, Kinesis, Kafka, Clickhouse, Postgres)
Strong Programming Skills: Proficiency in languages like Python, SQL, and experience with data pipeline tools.
Excellent Problem-Solving Skills: Ability to tackle complex challenges and provide efficient, innovative solutions.
Communication: Ability to communicate effectively with colleagues across various business functions.
About Us
Cloudsmith is the world’s most powerful artifact management platform. Software organizations of all sizes use Cloudsmith to protect and manage their software supply chain. Running at cloud scale in a multi-tenant software-as-a-service (SaaS) model, Cloudsmith hosts repositories that proxy and cache public open-source software (OSS) indexes, providing a platform that organizations can use to scan artifacts for security vulnerabilities, licensing issues, and malware, as well as implement policies that govern the use of artifacts and act as a dependency firewall. We support over 30 formats, with broad support for languages, containers, and operating system libraries. Cloudsmith is built for the enterprise, supporting modern security protocols and providing advanced features for observability, integration, and orchestration. Customers use Cloudsmith as part of their CI/CD build chain, as well as for developer-native distribution of their own artifacts and binaries to end-customers.
We help our customers manage and secure their software supply chain, and improve their developer experience. We are by developers, for developers. Our culture operates with openness and transparency, driven by our ambition to build a great company. We enjoy working with great people and customers. We learn, support one another, and we’re growing. Now is a great time to join us.
Benefits:
- Competitive Salary and Equity Package
- Comprehensive Health, Dental, and Vision Insurance
- Generous Annual Leave and Flexible Working Policies
- Professional Development Budget for Conferences and Training
- Dynamic, Innovative, and Supportive Work Environment
Health and Wellness
Regardless of your location, we deeply care about the health and wellness of our staff and their families; a sustainable pace is important to us. In addition to generous annual leave (PTO), we offer parental leave and health benefits that can cover you and your dependents up to 100%. We also offer flexible family-friendly working policies.
Personal Growth
You will have an enormous scope to learn new skills alongside your colleagues, and your continued professional development is essential to us because it's important to you. We will support you with budgets for equipment, training, books, conferences, travel, and certifications. The more powerful you become, the better for all of us.
Remote First
Like our product, we’re fully distributed and operate remotely. Our headquarters is in Belfast, and we come together monthly for internal conferences and when it makes sense to collaborate in-person. We also hold all-hands offsites in Belfast three times per year, with guest speakers and team activities. On a day-to-day basis, most Cloudsmithers work remotely, and rely heavily on our collaboration tools which include Slack, Zoom, Notion and VS Code Live Share.
About Equal Opportunity
We’re an equal opportunities employer who is proud to nurture a workplace that welcomes applications from individuals of all races, genders, and ethnic groups and we do not discriminate on age, religion, sexual orientation, citizenship status, military service, or health conditions. We will not tolerate discrimination of any kind within our workforce.
- Department
- Engineering
- Locations
- NI/GB/ROI
About Cloudsmith
Data Engineer
Already working at Cloudsmith?
Let’s recruit together and find your next colleague.