Skip to content
Open
Due by August 29, 2025
Last updated Mar 18, 2025
0% complete

brick

July & August 2025

Mission: Transform Cortex from a standalone inference server into a robust AI development platform with advanced context capabilities.

Integration & Intelligence

During these months, we're building the foundation for more sophisticated AI applications. We'll focus on developing SDKs for multiple languages to make Cortex integration seamless across different dev environments. Adding memory capabilities will allow for persistent conversations, while our RAG implementation will enable knowledge-grounded responses. A new syncing layer will keep distributed deployments consistent across environments.

We could also incorporate:

  • Workflow orchestration for multi-step AI processes
  • Fine-tuning toolkit for model customization
  • Vector database integrations for efficient knowledge retrieval
  • Custom plugin architecture for extensibility
  • Interactive playground for rapid prototyping
  • Monitoring dashboard for inference tracking

Key Deliverables:

  • JavaScript and Python SDKs
  • Conversation memory system
  • Retrieval Augmented Generation (RAG) framework
  • Multi-environment syncing mechanism (optional)
  • Metrics Endpoint
  • Workflow orchestration tools (optional)
  • Plugin system for custom extensions
  • Model fine-tuning capabilities (optional)
  • Performance monitoring dashboard

The Thinking Brick milestone represents our evolution from a fast inference engine to a complete AI development platform - solid as a brick but with the intelligence to adapt and learn.

List view

  • Status: Open.
    #1894 In menloresearch/cortex.cpp;
    · ramonpzg opened on Jan 29, 2025
  • Status: Open.
    #1162 In menloresearch/cortex.cpp;
    · dan-menlo opened on Sep 8, 2024