What problem does chat memory eventually run into as a conversation gets long, and how is it typically handled?

Every message in history counts against the model's token limit and increases cost per call, so an unbounded conversation eventually either hits the context window or gets prohibitively expensive. Common mitigations are a sliding window (keep only the last N messages) or summarizing older turns into a compact summary that's kept instead of the full text.