☆ Yσɠƚԋσʂ ☆

  • 143 Posts
  • 27 Comments
Joined 7 years ago
cake
Cake day: January 18th, 2020

help-circle






  • It turns out that there might be an elegant way around bloated context windows and slow inference speeds. Instead of stuffing thousands of text tokens into a prompt like standard retrieval setups do, Memorilla approach encodes an entire document collection into just 16 query dependent latent tokens. The system drops these soft memory tokens directly into the input embedding space of a frozen LLM. Doing so averages 394 times fewer document tokens than a full context baseline and 113 times fewer than a standard fifty document retrieval method. Aside from saving massive amounts of compute overhead, the system also beats full context inference on complex multi document reasoning tasks. It hit 84.33 percent accuracy on the FactKG dataset compared to 80.43 percent for full context while using 108 times fewer tokens to represent the source documents.

    This approach also has implications for continuous learning and agentic workflows. Having persistent memory prevents the agent from getting stuck in stupid navigation loops between previously explored items. Because the initial document encoding is a one time shared cost, the decoder only processes a small number of memory tokens. You get continuous adaptation to new environments without overwriting prior knowledge or blowing up your active context limit. It’s a really clever way to decouple persistent knowledge storage from the active context window.








  • I mostly use DeepSeek and Kimi. I find DeepSeek is good enough to do most coding tasks, and Kimi does a good job with planning. And I suspect most people shitting on the ArtCraft apps haven’t actually used them. I’ve been using them for around two weeks now, and if anything, I’m impressed how well they work for being such new apps.

    PhotoCraft is better for me than GIMP and even PhotoGIMP because it’s much snappier, the UI/UX is far better because it just apes Photoshop, and the tasks I typically do all work fine. If you’re a professional doing complex things with layers and effects, it’s obviously not a replacement, but for casual use it’s great. And I can only assume it will continue getting better and features will be more fleshed out going forward.














  • I use PhotoCraft and LightCraft for my photo processing now which replaced two commercial apps for me. I tried using GIMP and DarkTable before, and found the UX was just too clunky for me. Neither app fully replicates the functionality, but they do enough of what I use day to day, and they feel snappy.

    Personally, what I’ve found to be more interesting though are the custom tools I can now easily build for myself. For example, I was able to make my own news aggregator that goes through a bunch of different news sources using rss, scraping, reading youtube transcripts. It doesn’t care what language the source is in, so I can get news from many different countries. Then it aggregates them to tell me what news are most widely reported, how stories evolve over time, find connections between them and give me a big picture overview. It took around a week to build, and it goes through hundreds of news sites each day to give me a briefing. Being able to make apps like this quickly that are customized to your exact workflow is something that just wasn’t easily doable before.