---
title: "Repo Fetcher"
description: "pull input source code/binary files from remote repositories"
source: "https://github.com/log-10x/modules/tree/main/pipelines/compile/modules/pull/module.yaml"
icon: "material/source-pull"
---
Pulls source code and binaries from [GitHub](https://doc.log10x.com/compile/pull/github/ "Pull folders from GitHub repositories to scan for symbol content"), [Helm](https://doc.log10x.com/compile/pull/helm/ "Pull GitHub repositories and Docker images to scan for symbol content from Helm charts"), [Docker](https://doc.log10x.com/compile/pull/docker/ "Pull Docker image files to scan for symbol content"), and [Artifactory](https://doc.log10x.com/compile/pull/artifactory/ "Pull files from Artifactory repositories to scan for symbol content").
Pulling [symbol files](https://doc.log10x.com/compile/scanner/symbol/ "Discover existing symbol unit files to reuse") generated by prior iterations of compile pipeline runs enables it avoid processing unchanged source code and binary input files, identified by stable checksums.
### :material-library-outline: Default Symbols
The 10x runtime comes with a built-in symbol library that includes symbols for industry-standard frameworks and infrastructure components. This pre-compiled symbol library enables immediate log optimization capabilities without requiring users to scan and compile symbols for common technologies and popular open-source projects.
??? tenx-symbols "Container Images (Helm Charts)"
Symbols extracted from Docker container images and their source code dependencies via Helm chart scanning.
| Helm Chart | Components |
|------------|------------|
| [open-telemetry/opentelemetry-demo](https://github.com/open-telemetry/opentelemetry-demo) | Polyglot microservices demo (14 services in Go, Java, Node.js, Python, .NET, Rust, PHP, Ruby, C++) |
| [ingress-nginx/ingress-nginx](https://github.com/kubernetes/ingress-nginx) | NGINX binary, HTTP error codes, upstream timeouts, load balancer logs |
| [prometheus-community/kube-prometheus-stack](https://github.com/prometheus-community/helm-charts) | Prometheus, Alertmanager, Grafana, node-exporter, kube-state-metrics |
??? tenx-symbols "Java Frameworks"
| Repository | Description |
|------------|-------------|
| [spring-projects/spring-boot](https://github.com/spring-projects/spring-boot) | REST APIs, auto-config, extensive logging |
| [spring-projects/spring-framework](https://github.com/spring-projects/spring-framework) | Core DI, AOP, transactions, error handling |
| [apache/tomcat](https://github.com/apache/tomcat) | Servlet container, HTTP access logs |
| [qos-ch/logback](https://github.com/qos-ch/logback) | Logging framework, defines log patterns |
| [qos-ch/slf4j](https://github.com/qos-ch/slf4j) | Logging facade, common log interfaces |
| [apache/logging-log4j2](https://github.com/apache/logging-log4j2) | Logging framework, pattern layouts |
| [eclipse-vertx/vert.x](https://github.com/eclipse-vertx/vert.x) | Reactive toolkit, event loop logs |
| [quarkusio/quarkus](https://github.com/quarkusio/quarkus) | Cloud-native, startup and request logs |
| [micronaut-projects/micronaut-core](https://github.com/micronaut-projects/micronaut-core) | Microservices, DI, data access logs |
| [apache/kafka](https://github.com/apache/kafka) | Distributed streaming, broker logs |
| [apache/spark](https://github.com/apache/spark) | Big data, job execution logs |
| [apache/flink](https://github.com/apache/flink) | Stream processing, job/task manager |
| [hibernate/hibernate-orm](https://github.com/hibernate/hibernate-orm) | ORM, SQL generation, transaction logs |
| [apache/camel](https://github.com/apache/camel) | Integration routes, message flow |
| [dropwizard/dropwizard](https://github.com/dropwizard/dropwizard) | REST, health checks, metrics |
| [reactor/reactor-core](https://github.com/reactor/reactor-core) | Reactive streams, error handling |
| [spring-cloud/spring-cloud-gateway](https://github.com/spring-cloud/spring-cloud-gateway) | API gateway, modern replacement for Zuul |
| [grpc/grpc-java](https://github.com/grpc/grpc-java) | RPC framework, client/server logs |
| [apache/dubbo](https://github.com/apache/dubbo) | RPC framework, service invocation |
| [netty/netty](https://github.com/netty/netty) | Async networking, channel logs |
| [apache/pulsar](https://github.com/apache/pulsar) | Pub/sub messaging |
| [elastic/elasticsearch](https://github.com/elastic/elasticsearch) | Search engine, indexing logs |
| [apache/cassandra](https://github.com/apache/cassandra) | NoSQL database, query logs |
| [mybatis/mybatis-3](https://github.com/mybatis/mybatis-3) | Persistence, SQL execution |
| [apache/activemq](https://github.com/apache/activemq) | Message broker, queue operations |
| [alibaba/nacos](https://github.com/alibaba/nacos) | Service discovery and configuration |
| [jetty/jetty.project](https://github.com/jetty/jetty.project) | Web server, HTTP requests, servlet context |
| [hazelcast/hazelcast](https://github.com/hazelcast/hazelcast) | Distributed computing, cluster membership |
| [apache/shiro](https://github.com/apache/shiro) | Security, authentication/authorization |
??? tenx-symbols "Node.js / JavaScript"
| Repository | Description |
|------------|-------------|
| [nodejs/node](https://github.com/nodejs/node) | Runtime core, errors, module loading |
| [expressjs/express](https://github.com/expressjs/express) | Web framework, HTTP middleware |
| [nestjs/nest](https://github.com/nestjs/nest) | Enterprise framework, exceptions |
| [vercel/next.js](https://github.com/vercel/next.js) | React SSR, routing, build logs |
| [fastify/fastify](https://github.com/fastify/fastify) | Web framework, request lifecycle |
| [koajs/koa](https://github.com/koajs/koa) | Middleware framework, error handling |
| [hapijs/hapi](https://github.com/hapijs/hapi) | Server framework, validation |
| [socketio/socket.io](https://github.com/socketio/socket.io) | WebSocket, connection events |
| [winstonjs/winston](https://github.com/winstonjs/winston) | Logging library, transports |
| [pinojs/pino](https://github.com/pinojs/pino) | Logging library, fast JSON logs |
| [log4js-node/log4js-node](https://github.com/log4js-node/log4js-node) | Logging framework, appenders |
| [debug-js/debug](https://github.com/debug-js/debug) | Debugging utility, namespaced logs |
| [adonisjs/core](https://github.com/adonisjs/core) | MVC framework, exception handling |
| [grpc/grpc-node](https://github.com/grpc/grpc-node) | gRPC for Node.js |
| [typeorm/typeorm](https://github.com/typeorm/typeorm) | ORM, query execution logs |
| [sequelize/sequelize](https://github.com/sequelize/sequelize) | ORM, SQL query logs |
| [prisma/prisma](https://github.com/prisma/prisma) | ORM, database queries |
| [axios/axios](https://github.com/axios/axios) | HTTP client, request/response logs |
| [Automattic/mongoose](https://github.com/Automattic/mongoose) | MongoDB ODM, query execution |
| [jaredhanson/passport](https://github.com/jaredhanson/passport) | Authentication, OAuth flows |
| [OptimalBits/bull](https://github.com/OptimalBits/bull) | Job queue, job lifecycle |
??? tenx-symbols "Python Frameworks"
| Repository | Description |
|------------|-------------|
| [django/django](https://github.com/django/django) | Web framework, request/response |
| [tiangolo/fastapi](https://github.com/tiangolo/fastapi) | Async web framework, validation |
| [pallets/flask](https://github.com/pallets/flask) | Micro web framework, routing |
| [encode/starlette](https://github.com/encode/starlette) | ASGI framework, middleware |
| [aio-libs/aiohttp](https://github.com/aio-libs/aiohttp) | Async HTTP client/server |
| [tornadoweb/tornado](https://github.com/tornadoweb/tornado) | Async networking, request handling |
| [Pylons/pyramid](https://github.com/Pylons/pyramid) | Web framework, traversal logs |
| [falconry/falcon](https://github.com/falconry/falcon) | REST API framework, hooks |
| [celery/celery](https://github.com/celery/celery) | Distributed task queue, worker logs |
| [apache/airflow](https://github.com/apache/airflow) | Workflow orchestration, task execution |
| [sqlalchemy/sqlalchemy](https://github.com/sqlalchemy/sqlalchemy) | ORM, SQL execution logs |
| [requests/requests](https://github.com/requests/requests) | HTTP library, request logs |
| [python/cpython](https://github.com/python/cpython) | Python runtime, core exceptions |
| [Delgan/loguru](https://github.com/Delgan/loguru) | Popular structured logging library |
| [hynek/structlog](https://github.com/hynek/structlog) | Structured logging for production |
| [scrapy/scrapy](https://github.com/scrapy/scrapy) | Web scraping, spider lifecycle |
| [benoitc/gunicorn](https://github.com/benoitc/gunicorn) | WSGI server, worker lifecycle |
| [encode/uvicorn](https://github.com/encode/uvicorn) | ASGI server, access logs |
| [boto/boto3](https://github.com/boto/boto3) | AWS SDK, service operations |
| [encode/httpx](https://github.com/encode/httpx) | HTTP client, HTTP/2 multiplexing |
??? tenx-symbols "Go Frameworks"
| Repository | Description |
|------------|-------------|
| [gin-gonic/gin](https://github.com/gin-gonic/gin) | Web framework, HTTP logs |
| [gofiber/fiber](https://github.com/gofiber/fiber) | Web framework, request handling |
| [labstack/echo](https://github.com/labstack/echo) | Web framework, middleware |
| [go-gorm/gorm](https://github.com/go-gorm/gorm) | ORM library, SQL logs |
| [beego/beego](https://github.com/beego/beego) | Web framework, MVC logs |
| [revel/revel](https://github.com/revel/revel) | Web framework, controller logs |
| [gorilla/mux](https://github.com/gorilla/mux) | HTTP router, request logs |
| [go-kratos/kratos](https://github.com/go-kratos/kratos) | Microservices, service logs |
| [valyala/fasthttp](https://github.com/valyala/fasthttp) | HTTP library, connection logs |
| [grpc/grpc-go](https://github.com/grpc/grpc-go) | gRPC for Go |
| [uber-go/zap](https://github.com/uber-go/zap) | Structured logging library |
| [sirupsen/logrus](https://github.com/sirupsen/logrus) | Logging library |
| [etcd-io/etcd](https://github.com/etcd-io/etcd) | Distributed KV store, raft logs |
| [temporalio/temporal](https://github.com/temporalio/temporal) | Workflow orchestration, activity execution |
??? tenx-symbols "C++ / Core Libraries"
| Repository | Description |
|------------|-------------|
| [grpc/grpc](https://github.com/grpc/grpc) | RPC framework, channel logs |
| [protocolbuffers/protobuf](https://github.com/protocolbuffers/protobuf) | Serialization, parsing errors |
| [mongodb/mongo](https://github.com/mongodb/mongo) | Database, query execution |
| [facebook/rocksdb](https://github.com/facebook/rocksdb) | Key-value store, compaction logs |
| [ClickHouse/ClickHouse](https://github.com/ClickHouse/ClickHouse) | OLAP database, query logs |
| [duckdb/duckdb](https://github.com/duckdb/duckdb) | Emerging analytical database |
| [apache/thrift](https://github.com/apache/thrift) | RPC framework, service calls |
| [gabime/spdlog](https://github.com/gabime/spdlog) | High-performance logging library |
??? tenx-symbols "Scala Frameworks"
| Repository | Description |
|------------|-------------|
| [akka/akka](https://github.com/akka/akka) | Actor concurrency, message logs |
| [playframework/playframework](https://github.com/playframework/playframework) | Web framework, action logs |
| [zio/zio](https://github.com/zio/zio) | Concurrent effects, fiber logs |
??? tenx-symbols "Rust Frameworks"
| Repository | Description |
|------------|-------------|
| [tokio-rs/tokio](https://github.com/tokio-rs/tokio) | Async runtime, task spawn/complete events |
| [actix/actix-web](https://github.com/actix/actix-web) | Rust web framework, middleware chain logs |
| [tokio-rs/axum](https://github.com/tokio-rs/axum) | Rust web framework, Tower service spans |
| [rwf2/Rocket](https://github.com/rwf2/Rocket) | Rust web framework, route mounting logs |
| [tokio-rs/tracing](https://github.com/tokio-rs/tracing) | Structured logging, span hierarchy |
??? tenx-symbols "Ruby Frameworks"
| Repository | Description |
|------------|-------------|
| [rails/rails](https://github.com/rails/rails) | Web framework, controller actions, SQL logs |
| [sidekiq/sidekiq](https://github.com/sidekiq/sidekiq) | Ruby background jobs, worker lifecycle |
| [puma/puma](https://github.com/puma/puma) | Web server, thread pool stats |
??? tenx-symbols ".NET / C# Frameworks"
| Repository | Description |
|------------|-------------|
| [dotnet/aspnetcore](https://github.com/dotnet/aspnetcore) | Web framework, HTTP pipeline, auth events |
| [dotnet/efcore](https://github.com/dotnet/efcore) | .NET Entity Framework, SQL query logging |
| [serilog/serilog](https://github.com/serilog/serilog) | .NET structured logging, message templates |
| [NLog/NLog](https://github.com/NLog/NLog) | Logging framework, layout renderers |
??? tenx-symbols "Kubernetes / Cloud-Native"
| Repository | Description |
|------------|-------------|
| [prometheus/prometheus](https://github.com/prometheus/prometheus) | Monitoring, scrape lifecycle, TSDB operations |
| [istio/istio](https://github.com/istio/istio) | Service mesh, xDS config, mTLS events |
| [envoyproxy/envoy](https://github.com/envoyproxy/envoy) | Proxy, access logs, circuit breakers |
| [argoproj/argo-cd](https://github.com/argoproj/argo-cd) | GitOps, sync events, health status |
| [helm/helm](https://github.com/helm/helm) | Package manager, chart lifecycle |
| [grafana/loki](https://github.com/grafana/loki) | Log aggregation, ingester operations |
| [jaegertracing/jaeger](https://github.com/jaegertracing/jaeger) | Distributed tracing, span collection |
| [containerd/containerd](https://github.com/containerd/containerd) | Container runtime, image pulls, task execution |
??? tenx-symbols "Databases and Messaging"
| Repository | Description |
|------------|-------------|
| [redis/redis](https://github.com/redis/redis) | In-memory store, command logs, persistence |
| [postgres/postgres](https://github.com/postgres/postgres) | Relational DB, SQLSTATE codes, query logs |
| [cockroachdb/cockroach](https://github.com/cockroachdb/cockroach) | Distributed SQL, raft consensus, range splits |
| [mysql/mysql-server](https://github.com/mysql/mysql-server) | Relational DB, InnoDB engine, replication |
| [rabbitmq/rabbitmq-server](https://github.com/rabbitmq/rabbitmq-server) | Message broker, AMQP frames, queue lifecycle |
| [nats-io/nats-server](https://github.com/nats-io/nats-server) | Messaging, JetStream ops, cluster routing |
| [pingcap/tidb](https://github.com/pingcap/tidb) | Distributed SQL, optimizer, TiKV events |
| [vitessio/vitess](https://github.com/vitessio/vitess) | MySQL sharding, tablet state, vreplication |
??? tenx-symbols "Security and Identity"
| Repository | Description |
|------------|-------------|
| [hashicorp/vault](https://github.com/hashicorp/vault) | Secrets management, audit logs, seal/unseal |
| [keycloak/keycloak](https://github.com/keycloak/keycloak) | IAM, authentication events, token issuance |
??? tenx-symbols "ML / AI Frameworks"
| Repository | Description |
|------------|-------------|
| [pytorch/pytorch](https://github.com/pytorch/pytorch) | Deep learning, training epochs, CUDA events |
| [huggingface/transformers](https://github.com/huggingface/transformers) | NLP models, tokenization, inference logs |
## :octicons-package-24: Modules
- :material-github:{ .lg .middle } __GitHub Repositories__
---
Pull folders from GitHub repositories to scan for symbol content.
[:octicons-arrow-right-24: More info](/compile/pull/github)
- :material-docker:{ .lg .middle } __Docker Image__
---
Pull Docker image files to scan for symbol content.
[:octicons-arrow-right-24: More info](/compile/pull/docker)
- :simple-helm:{ .lg .middle } __Helm Chart__
---
Pull GitHub repositories and Docker images to scan for symbol content from Helm charts.
[:octicons-arrow-right-24: More info](/compile/pull/helm)
- :simple-jfrog:{ .lg .middle } __Artifactory Repositories__
---
Pull files from Artifactory repositories to scan for symbol content.
[:octicons-arrow-right-24: More info](/compile/pull/artifactory)
:material-github: This module is defined in [pull/module.yaml](https://github.com/log-10x/modules/tree/main/pipelines/compile/modules/pull/module.yaml "pull/module.yaml"){target="\_blank"}.