Use Annotations and Labels Effectively

Description

Utilize annotations and dynamic labeling within Prometheus metrics to provide more context about the data, such as version numbers, environment tags, or other descriptive labels that help in filtering and querying data more effectively. This task involves modifying scrape configurations and alert rules to use these labels and annotations dynamically.