Skip to content

Span Buffer Multiprocess Enhancement with Health Monitoring#5

Open
adamsaimi wants to merge 1 commit intospan-flusher-stablefrom
span-flusher-multiprocess
Open

Span Buffer Multiprocess Enhancement with Health Monitoring#5
adamsaimi wants to merge 1 commit intospan-flusher-stablefrom
span-flusher-multiprocess

Conversation

@adamsaimi
Copy link
Owner

Test 6

self.process_healthy_since[process_index].value = int(time.time())

# Create a buffer for these specific shards
shard_buffer = SpansBuffer(shards)
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[Performance] Excessive Redis Connections per Flusher Process

  • Problem: Each SpanFlusher process creates an independent Redis connection pool, potentially leading to an excessive number of connections and Redis overload when flusher_processes is high.
  • Fix: Implement a mechanism to limit total Redis connections across flusher processes or provide clear operational guidance on configuring flusher_processes relative to Redis capacity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants