customer is running a 72-hour test. I'm not sure if they are trying to test a DDoS or what, but the test seems to reliably fail around the 30 hour mark. Now, I haven't seen anything from the actual test. I think there is probably a security or application team involved and I am working with the systems team.
In any case, Infinispan is known to not survive gc because as a cache, it has a lot timeout. My thought was maybe they were having full gcs every 30 hours or so, but turns out they had 1689 full gcs in 7 hours. I told them that if they were trying to test full gcs, they needed to not test that often because it's not a realistic test. As far as the log was concerned, they were not actually able to evacuate properly, so that's one reason the gcs kept happening. They old gave the JVM 8GB RAM though. None of this makes any sense!
idk what they ended up changing, but they are running a new 72-hour test now, so something I said must have made sense to them.