Open source / Java 25

AI belongs inside the JVM.

A practical in-process stack for retrieval and inference. No Python sidecar, no separate vector database, and no mystery between the application and its model.

4 core foundationsApache 2.0Java 25

Search, run, distribute, remember.

Four projects that compose into one locally owned AI runtime while remaining useful on their own. Vectors carries the retrieval layer, Models runs inference on top of it, ModelJARs makes weights a normal build dependency, and Memory turns the pair into something an agent can keep.

The application is the platform.

For many workloads, intelligence does not need to live behind another service boundary. Keeping retrieval and inference in process reduces operational surface area and makes the system easier to understand, test, package, and own.

LOCAL / 01

In-process inference

Load open-weight GGUF models and generate text from Java without Python or a model server.

LOCAL / 02

Embedded retrieval

Search persistent vector collections without operating a separate vector-database service.

LOCAL / 03

Durable storage

Use generation-based memory-mapped persistence locally or hydrate from S3-compatible object storage.

LOCAL / 04

Measured execution

Choose Java, native, or platform backends from recorded capabilities and performance evidence.

LOCAL / 05

Framework adapters

Integrate with Spring AI and LangChain4j while retaining ownership of the underlying runtime.

LOCAL / 06

Standard packaging

Resolve model identities, versions, provenance, and checksums through familiar build coordinates.

Knowing which model to trust, and when.

A stack of models — frontier, local, and vertical — is only useful if something can tell them apart. We are building a qualification standard for models — what a model is actually good for, measured rather than asserted — and a channel for publishing and distributing the ones that pass, so a router can choose between local platform intelligence, a custom small model, and a vertical specialist on evidence.

Corpus · StandardRouting

Model router corpus

The reference corpus and qualification criteria behind intelligent routing: how candidate models are scored, compared, and published so a router can select on measured capability instead of reputation.

View corpus ↗
JavaPanamaPerformance

Vectors on the Vector API

Pushing Java 25's Vector API as far as it goes, shimming to Rust only where it cannot reach — and reporting back where each shim was needed, so the Panama, FFM, and incubating APIs can be made better.

Documentation ↗

Intelligence belongs inside the application.

We think the next decade of this work gets built inside ordinary software rather than beside it: retrieval, inference, and memory running in your own process, on hardware you already control, with weights that resolve like any other dependency and models chosen on measured capability rather than reputation. The JVM runs an enormous amount of the world's production software and has been treated as a second-class place to do it. We are building the foundations that change that, releasing them under Apache 2.0, and publishing the measurements — including the ones that mark where local execution stops being the right answer.

Asked and answered.

Do you need Python to run AI inside a Java application?

No. Vectors handles retrieval and Models handles inference, both inside your JVM process. There is no Python sidecar and no separate vector service to operate.

How do model weights get into a build?

ModelJARs publishes them as Maven artifacts. You add a coordinate and the weights resolve through the same dependency mechanism that brings in any other JAR.

When is a local model the wrong choice?

When the measurements say so. Model qualification exists to answer that per task rather than per reputation, and we publish the cases where a frontier model wins.

Build locally

Own the runtime. Inspect the stack.

Integrallis on GitHub ↗