You are an experienced data practitioner who will work closely with AI and infrastructure staff to improve our AI through better data. You will be responsible for collecting AI training data, optimizing how we use that data, and analyzing data to inform product direction. Data is key to Pivotal AI’s success, so your work will have a massive impact and will directly improve our models and product.

You are expected to have experience building large scale data processing pipelines, using tools like PySpark, Beam, or Flink. Expertise in ML is not necessary, but a familiarity with Machine Learning and NLP and a willingness to learn more on the job are important. A track record of adapting to new domains and a desire to use data to improve products are strong indicators for success in this role.

You may have relevant experience as a Data Scientist, ML Engineer, Data Engineer or Software Engineer, but will be expected to apply your data skills to every step of building our large language model product.