JPMorgan Chase rolls out its LLM Suite to 200,000 employees

The problem

JPMorgan restricted employee use of ChatGPT in early 2023 because of data exposure concerns. Staff still wanted generative AI for everyday writing and analysis, so the bank needed a safe alternative.

What they built

LLM Suite is a proprietary platform that gives eligible employees access to large language models in a secure environment. Employees use it to draft emails and reports, summarize long documents, solve Excel problems and generate ideas. Engineers can also add functions from external models to their own programs.

How they did it

CNBC reported that the bank did not build its own models. LLM Suite works as a portal to outside models, launched with OpenAI's, and the bank said it plans to avoid dependence on any single provider. It is designed so employee data is not used to train the models. JPMorgan's roadmap, per its own post, is to connect the tool to more internal data and combine it with workflows to create agents.

Results

JPMorganChase says the platform reached 200,000 onboarded users within eight months of its summer 2024 release. In August 2024, CNBC reported it was available to more than 60,000 employees with a wider rollout planned.