inside of a report, Groq suggests its LPUs are scalable and can be connected jointly utilizing optical interconnect across 264 chips. it may possibly more be scaled working with switches, but it can increase to latency. https://www.sincerefans.com/blog/groq-funding-and-products