Added Bucket-config as a configmap in a Block-sync init container.#838
Closed
kushalShukla-web wants to merge 761 commits intoprometheus:masterfrom
Closed
Added Bucket-config as a configmap in a Block-sync init container.#838kushalShukla-web wants to merge 761 commits intoprometheus:masterfrom
kushalShukla-web wants to merge 761 commits intoprometheus:masterfrom
Conversation
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.10.0 to 0.17.0. - [Commits](golang/net@v0.10.0...v0.17.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 6.0 to 6.0.1. - [Changelog](https://github.com/yaml/pyyaml/blob/6.0.1/CHANGES) - [Commits](yaml/pyyaml@6.0...6.0.1) --- updated-dependencies: - dependency-name: pyyaml dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
…s/load-generator/pyyaml-6.0.1 Bump pyyaml from 6.0 to 6.0.1 in /tools/load-generator
…es/golang.org/x/net-0.17.0 Bump golang.org/x/net from 0.10.0 to 0.17.0
…es/google.golang.org/grpc-1.56.3 Bump google.golang.org/grpc from 1.55.0 to 1.56.3
…s/load-generator/urllib3-1.26.18 Bump urllib3 from 1.26.15 to 1.26.18 in /tools/load-generator
Bumps [github.com/go-git/go-git/v5](https://github.com/go-git/go-git) from 5.4.2 to 5.10.0. - [Release notes](https://github.com/go-git/go-git/releases) - [Commits](go-git/go-git@v5.4.2...v5.10.0) --- updated-dependencies: - dependency-name: github.com/go-git/go-git/v5 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
…es/github.com/go-git/go-git/v5-5.10.0 Bump github.com/go-git/go-git/v5 from 5.4.2 to 5.10.0
Synchronize common files from prometheus/prometheus
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.8.0 to 0.13.0. - [Commits](golang/oauth2@v0.8.0...v0.13.0) --- updated-dependencies: - dependency-name: golang.org/x/oauth2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [prometheus-client](https://github.com/prometheus/client_python) from 0.17.0 to 0.17.1. - [Release notes](https://github.com/prometheus/client_python/releases) - [Commits](prometheus/client_python@v0.17.0...v0.17.1) --- updated-dependencies: - dependency-name: prometheus-client dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.213 to 1.46.4. - [Release notes](https://github.com/aws/aws-sdk-go/releases) - [Commits](aws/aws-sdk-go@v1.44.213...v1.46.4) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
…es/github.com/aws/aws-sdk-go-1.46.4 Bump github.com/aws/aws-sdk-go from 1.44.213 to 1.46.4
…es/golang.org/x/oauth2-0.13.0 Bump golang.org/x/oauth2 from 0.8.0 to 0.13.0
…s/load-generator/prometheus-client-0.17.1 Bump prometheus-client from 0.17.0 to 0.17.1 in /tools/load-generator
Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.31.0. - [Release notes](https://github.com/psf/requests/releases) - [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md) - [Commits](psf/requests@v2.28.2...v2.31.0) --- updated-dependencies: - dependency-name: requests dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com>
…s/load-generator/requests-2.31.0 Bump requests from 2.28.2 to 2.31.0 in /tools/load-generator
Signed-off-by: prombot <prometheus-team@googlegroups.com>
Signed-off-by: Jesus Vazquez <jesusvzpg@gmail.com>
Synchronize common files from prometheus/prometheus
…cies Update test-infra go modules
Signed-off-by: bwplotka <bwplotka@gmail.com>
Signed-off-by: prombot <prometheus-team@googlegroups.com>
Due to the removal of provider-specific authentication code from kubectl in Kubernetes v1.26, Prombench experiences connectivity issues. This commit temporarily reinstates the legacy GCP plugin to maintain functionality. A transition to the new `gke-gcloud-auth-plugin` will be planned for future releases to align with the updated GKE authentication process. Signed-off-by: Julien Pivotto <roidelapluie@o11y.eu>
Implement temporary legacy auth fix for GKE in prombench
* Prombench: scrape cAdvisor metrics So that queries for container_memory_rss return some data. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Prombench: adjust load-gen queries In some cases reduce the amount of data returned; in others reduce the frequency so there is a gap between one batch and the next. node_cpu has been renamed to node_cpu_seconds_total. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> --------- Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
Bumps [idna](https://github.com/kjd/idna) from 3.4 to 3.6. - [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst) - [Commits](kjd/idna@v3.4...v3.6) --- updated-dependencies: - dependency-name: idna dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [cloud.google.com/go/container](https://github.com/googleapis/google-cloud-go) from 1.26.2 to 1.29.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@container/v1.26.2...pubsub/v1.29.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/container dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
…es/cloud.google.com/go/container-1.29.0 Bump cloud.google.com/go/container from 1.26.2 to 1.29.0
* Do nothing if secret is empty. * add newline at bottom of file. * Renamed key.yml to object-config.yml file. * Replaced key with path and other parts of the file. Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com>
Signed-off-by: prombot <prometheus-team@googlegroups.com>
Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com>
* Created Service and Deployment configuration for Prometheus sink * 1. Added cpu and memory usage to remote-write. 2. make clusterIp headless. Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com>
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
More realistic for end-user workloads; less expensive in cloud resources. Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
Best to tell the system what is needed. Specific levels based on observing at GKE. Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
Prombench: add Kubernetes resource requests
Prombench: slow scraping from 5s to 15s
Bumps [sigs.k8s.io/kind](https://github.com/kubernetes-sigs/kind) from 0.24.0 to 0.25.0. - [Release notes](https://github.com/kubernetes-sigs/kind/releases) - [Commits](kubernetes-sigs/kind@v0.24.0...v0.25.0) --- updated-dependencies: - dependency-name: sigs.k8s.io/kind dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.23.0 to 0.24.0. - [Commits](golang/oauth2@v0.23.0...v0.24.0) --- updated-dependencies: - dependency-name: golang.org/x/oauth2 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Changed Upload functionality to upload TSDB data only
…metheus#805) Some examples on how old one works (vs the unit test I added): prometheus/prometheus#15487 Signed-off-by: bwplotka <bwplotka@gmail.com>
) Bumps [cloud.google.com/go/container](https://github.com/googleapis/google-cloud-go) from 1.41.0 to 1.42.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.41.0...pubsub/v1.42.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/container dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.205.0 to 0.211.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](googleapis/google-api-go-client@v0.205.0...v0.211.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…` flags. (prometheus#812) * comment-monitor: Added flag support; added built-in help command. Implements first phase of prometheus/proposals#41 Signed-off-by: bwplotka <bwplotka@gmail.com> * prombench: Added support for `--bench.version` and `--bench.directory` flags. See prometheus/proposals#41 for rationale. Prometheus job got updated with prometheus/prometheus#15682 Signed-off-by: bwplotka <bwplotka@gmail.com> * extended comment to include version and directory used. Signed-off-by: bwplotka <bwplotka@gmail.com> * addressed comments. Signed-off-by: bwplotka <bwplotka@gmail.com> * Makefile fix. Signed-off-by: bwplotka <bwplotka@gmail.com> * rm unnecessary print. Signed-off-by: bwplotka <bwplotka@gmail.com> * Improved help. Signed-off-by: bwplotka <bwplotka@gmail.com> * Fixed help. Signed-off-by: bwplotka <bwplotka@gmail.com> * Added missed test file. Signed-off-by: bwplotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com>
…rometheus#813) No openssh installed, and fingerprint ask, so switching to HTTPs for git. alpine mktemp does not have -t apparently too. Signed-off-by: bwplotka <bwplotka@gmail.com>
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.67.1 to 1.69.0. - [Release notes](https://github.com/grpc/grpc-go/releases) - [Commits](grpc/grpc-go@v1.67.1...v1.69.0) --- updated-dependencies: - dependency-name: google.golang.org/grpc dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Add PRW 2.0 traffic, improved sink debugging flow. Signed-off-by: bwplotka <bwplotka@gmail.com> * Removed PRW 2.0 as it depends on expensive metadata-wal-records feature. Signed-off-by: bwplotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com>
…ch runs (prometheus#833) This custom image is locally build from prometheus/golang-builder#296 that we agree to pause until Prometheus release. However, Prometheus release needs working prombench. This is a tmp solution until we have an official image. Mitigates prometheus#832 Signed-off-by: bwplotka <bwplotka@gmail.com>
Signed-off-by: prombot <prometheus-team@googlegroups.com>
Bumps [sigs.k8s.io/kind](https://github.com/kubernetes-sigs/kind) from 0.25.0 to 0.26.0. - [Release notes](https://github.com/kubernetes-sigs/kind/releases) - [Commits](kubernetes-sigs/kind@v0.25.0...v0.26.0) --- updated-dependencies: - dependency-name: sigs.k8s.io/kind dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.32.0 to 0.33.0. - [Commits](golang/net@v0.32.0...v0.33.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
from block-sync. Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com> Signed-off-by: Kushal Shukla <197915417+Kakarot777-boop@users.noreply.github.com>
Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com> Signed-off-by: Kushal Shukla <197915417+Kakarot777-boop@users.noreply.github.com>
Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com> Signed-off-by: Kushal Shukla <197915417+Kakarot777-boop@users.noreply.github.com>
Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com> Signed-off-by: Kushal Shukla <197915417+Kakarot777-boop@users.noreply.github.com>
Signed-off-by: Kushal Shukla <kushalshukla110@gmail.com> replaced key with blocksync-location-key
kushalShukla-web
force-pushed
the
block
branch
from
04d1941 to
8ec01c3
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
14 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Following prometheus/test-infra#779 and prometheus/prometheus#15183, the placement of the
bucket-configfile in the Prometheus repository has created some inconsistencies, such as:bucket-configfile is required in multiple parts of PromBench, such as the Load Generator to query downloaded block data. This leads to downloading the entire Prometheus repository, which is not an efficient solution.To address these issues, I have moved all bucket configuration into a ConfigMap.