Clone the codebases of three types of projects—instrumentation libraries, agent development frameworks, and agents—to the local machine for investigation.
- Has instrumentation been implemented? 1.1. If yes, how is instrumentation done? 1.2. What information is collected?
- Has LLM message collection been done? 2.1. If yes, how are LLM messages collected? 2.2. In what type of telemetry are these messages written? Logs or traces? Which specific field?
markdown
Make a research and write the report into markdown file. Question 2 and 3 is for agent frameworks and agent proejcts. Question 1 is for OpenTelemetry's projects:
1. What is the latest progress of agent observability according to OTel's repo(community, semantic-conventions and opentelemetry-specification)?
3.1 Does OTel suggest any instrumentation library?
3.2 What information OTel suggest to collect?
3.3 Does OTel suggest collecot the LLM messages?
3.4 Which field should be store the LLM messages?
3.5 Any thing with observability 2.0?
2. If this project has been instrumented (not for instrumentation library)
2.1 If so, how instrumentation implemented. Using what library?
2.2 Collect what information?
2.3 Store them into what kind of telemetry? traces, metris, logs, wide event(observability 2.0) or their own data structure.
2.4 Does instrumentation follow the best practices or standard designed by OpenTelemetry
3. If this project collect the LLM messages
3.1 If so, how LLM messages been collected?
3.2 Which kind of telemetry store the LLM messages? traces, metris, logs, wide event(observability 2.0) or their own data structure.
3.3 Which field the LLM message has been write down?
3.4 If this instrumentation follow the best practices or standard designed by OpenTelemetry