news.volyx.in

Ollaya – Ollama for open-source, Jev-style decision models (ollaya.dev)

617 points by Ardakilic · 15 days ago · 145 comments on HN

Article summary

Ollaya is an open-source platform that allows users to run decision models locally, providing a private and cost-effective alternative to cloud-based services. The platform supports various models, including Laya, Decider, and Qwen3guard, which can be used for tasks such as text classification and decision-making. Ollaya claims to offer fast and calibrated results, with some models capable of processing requests in milliseconds. The platform is designed to be compatible with TypeSafe's API, allowing for seamless integration with existing applications.

Main themes

  • Decision Models
  • Open-Source AI
  • Private and Local Processing
  • Model Quality and Comparison
  • Transparency and Openness in AI
  • Marketing and Hype in AI Industry
  • Cost-Effectiveness and Accessibility of AI Solutions

What commenters say

  • Some commenters argue that Jev-style decision models are not significantly different from traditional classifiers, and that the marketing language used to describe them is misleading.
  • Others believe that open-source alternatives like Ollaya are essential for safe and transparent AI development, and that proprietary models like Jev will eventually be surpassed by community-driven efforts.
  • There is disagreement about the quality of Laya's decision-making capabilities compared to Jev, with some commenters finding Laya to be significantly weaker, especially on complex queries.
  • A few commenters suggest that the ease of generating large datasets and fine-tuning models like Laya makes it unnecessary to pay for proprietary services like Jev.
  • Some argue that the size of the model is not the only factor determining its quality, and that smaller models like Laya can still be effective for specific tasks.
  • The importance of transparency and openness in AI development is emphasized by some commenters, who argue that proprietary models can be detrimental to progress in the field.
  • Others propose that the difference in performance between Laya and Jev may be due to the size and quality of the training data, rather than any fundamental difference in the models themselves.