Show HN: Self hosting a modern LLM stack

 (github.com)

5 points | by sleepynoodle 1 hour ago

1 comments

  • mateenah 1 hour ago
    Have you tried running really large models with this? And how are you managing allocating resources ?