within a report, Groq suggests its LPUs are scalable and may be joined with each other utilizing optical interconnect across 264 chips. it may possibly even more be scaled using switches, but it will insert to latency. https://www.sincerefans.com/blog/groq-funding-and-products