20000 forum users - Awesome Special Event!

You’re not late! Thank you!

5 Likes

The good news is that blackbox ai cli has been updated and seems like it is fixed

The bad news is that it still gets dumber the longer you use it until you start a new session then its smart again but has forgotten everything

I decided to download the blackbox cli source and investigate why

I discovered that blackbox ai cli sends the whole chat history with every prompt, after a while this becomes too large for the ai to process

At this point blackbox decides to reduce the oldest 70% of the history to just a summary so it can fit but this throws away vital project information which explains why a useful tool suddenly becomes dumb and no longer able to understand anything about the current project

I had to fix this, I’ve been modifying the code and so far I have this

  Major Architecture Change
  The project underwent a retrieval-based context system overhaul:


  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
  β”‚ Aspect            β”‚ Old System          β”‚ New System           β”‚
  β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
  β”‚ Context sent      β”‚ Entire history      β”‚ Only relevant hints  β”‚
  β”‚ Local history     β”‚ Compressed/modified β”‚ Never touched        β”‚
  β”‚ Compression       β”‚ Full history        β”‚ Only hints if needed β”‚
  β”‚ Data loss         β”‚ Yes                 β”‚ Never                β”‚
  β”‚ Long-term quality β”‚ Degrades            β”‚ Maintained           β”‚
  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜


  Benefits:
   - No data loss - full conversation history preserved locally
   - Faster responses - fewer tokens sent to AI
   - Lower costs - reduced API usage
   - Fixes "AI gets dumber over time" issue
   - Semantic search finds relevant context by meaning, not just recency

  This is a modern RAG (Retrieval-Augmented Generation) approach replacing the old compression-based system.

I’m still testing but so far it seems to perform very well, right now I have this as a private github but after testing I’ll make it public

5 Likes

Can you increase the context window?
LM Studio and Ollama has this option

4 Likes

I’ll check that

But I haven’t needed to since I rewrote the system

5 Likes

Actual Linux running on iOS with 3D acceleration

5 Likes

cant wait to run doom on it XD

2 Likes

I don’t know how to play doom and this is the best I can do :laughing:

8 Likes

Tinkering with my Windows Server 2012 R2 VPS…

Apparently I screwed up Active Directory and Remote Desktop Services so bad that I’m now reinstalling the OS

6 Likes

dwservice and chrome remote desktop is always the best, i dont use rdp much

uhhh 0.5$ for a 1 core 512mb ram vps is a good deal or not??

seems like perfect for cron job server or some worker stuff

4 Likes

I need Remote Desktop Services lol

Because I don’t just need to remote into my server, I need the extra features provided by RDS

And no RDS is not just the included Remote Desktop in Windows

6 Likes

oh my god 0.5$ vps is not a scam holy moly

3 Likes

At least you have 1 Core 512 MB

Do you know that in China there’s something like 0.2 Cores 128 MB VPS with 1 Mbps bandwidth

6 Likes

i bet that thing is for cron job for a long time, running one single script to cron job or call some api for a long time without maintain idk im just assuming

3 Likes

People literarily run nginx and even php on these shitty servers, not just some random cron servers that ping random stuffs

Oh and 1 Mbps is not β€œslow” even if it is, providers will literarily call 5 Mbps as β€œhigh speed”

6 Likes

h o w???

oh btw how much did it cost per month?

More expensive than yours :zany_face:

I think it is around $0.6, and if you need 256 MB or 0.4 Cores the prices quickly goes to $1-2 per month


This thing is taking forever why :sob:

6 Likes

xampp + cloudflared :skull:

overkill windows server lol

I screwed up again

I hate Active Directory :melting_face:

But well I guess the current setup could work as well, at least the domain is correct


I love Active Directory and Remote Desktop Services :heart:

5 Likes

Mmm, 8.1 Server! :face_savoring_food:

100Mbps for 5 CENTS!? :wilted_flower:

My country’s mobile internet in 2013 or something :pensive_face:

Never got around to tinker with it :thinking:

Pi 4 in the wild!

4 Likes

I believe that is 50 cents not 5 cents


5 Likes