AI & ML interests

Hi! We are making an AI powered DDoS recognition system for netgoat.xyz

Recent Activity

FlameF0X submitted a paper 10 days ago

Triplet-Block Diffusion RWKV

duckeydevv updated a dataset about 2 months ago

netgoat-ai/SynthWAF-2-Experimental

duckeydevv published a dataset about 2 months ago

netgoat-ai/SynthWAF-2-Experimental

View all activity

FlameF0X

posted an update 5 days ago

Post

7007

MiniMax-M3 coming soon.
https://github.com/MiniMax-AI/MiniMax-M3

FlameF0X

submitted a paper to Daily Papers 10 days ago

Triplet-Block Diffusion RWKV

Paper • 2605.25969 • Published 13 days ago • 23

FlameF0X

posted an update 21 days ago

Post

272

I did some testing on the scalability of FWKV. It hits a speed bottleneck at 1B due to the T4’s bandwidth limitations. Theoretically, it should match RWKV’s inference speed if the GPU had more bandwidth. So the 1B size is not accurate.

FlameF0X

posted an update 22 days ago

Post

277

Greetings Hugging Face!

I started a new project called **FWKV** (Feed-forward Weighted Key Value, or Floored Weighted Key Value), a RWKV-style LM that uses FFNNs (Feed-Forward Neural Networks) instead of RNN and floor(W·K·V). I'm hoping to make it much more efficient and scalable than RWKV.

So far I have:

- FlameF0X/FWKV-29M — this one is undertrained and doesn't have a Space yet. In the attached image you can see its speed on a T4 compared to models with the same configuration.

The only model that's fully working right now is:
- FlameF0X/FWKV-TinyStories — trained on TinyStories for one epoch. The demo Space is FlameF0X/FWKV-demo.