Notice: You have been identified as a bot, so no internal UID will be assigned to you. If you are a real person messing with your useragent, you should change it back to something normal.

Minichan

Topic: 17,000 tokens per second?

Mr. Bloody Lemonade !0JqexkOGBc started this discussion 1 hour ago #136,759

https://chatjimmy.ai/

Mr. Bloody Lemonade !0JqexkOGBc (OP) double-posted this 1 hour ago, 1 minute later[^] [v] #1,451,026

There are some major drawbacks to this. Mainly attributed to the fact that hardwired the weights of the model into the chip so the model can never ever be changed or updated.

…those are pretty enormous drawbacks.

Mr. Bloody Lemonade !0JqexkOGBc joined in and replied with this 53 minutes ago, 11 minutes later, 13 minutes after the original post[^] [v] #1,451,027

Of course this isn’t a new idea. Chips have done the same thing with video codes for ages. Just hardwire the program into the chip and now it’s extraordinary fast… as long as you never ever need to change it.
:

Please familiarise yourself with the rules and markup syntax before posting.