[TRI-1882] Python support

It would be great to offer support for Python.

Python has better support for many Machine Learning uses cases:

Many ML libraries are only Python, or more complete in Python
Some services have ML models that only work from Python (e.g. OpenAI's whisper model)
Data Science and Engineering tools like pandas

It would be even better if you could mix languages. Have files alongside each other that are different languages but can declare tasks.

_TRI-1882

Cloudflare Workers transpiles languages into JavaScript.

Cloudflare blog post: https://blog.cloudflare.com/cloudflare-workers-announces-broad-language-support
Languages that can compile to JS: https://github.com/jashkenas/coffeescript/wiki/List-of-languages-that-compile-to-JS
Transcrypt is used to compile Python to JS: https://www.transcrypt.org/docs/html/installation_use.html

Hey Matt, I'd love to use trigger.dev with Python! Any idea when this might happen?

Having this would be great! I want to do a job to run https://github.com/joshiayush/inb automatically and trigger.dev would be a great option if it offers support for Python.

+1 really need this.

pls advise on timeline

+1 would really enjoy that!

+1! Big use case for this is running python based crawlers and other AI inference tasks.

+1 it would be a great use case for gis applications as well :)

+1

https://feedback.trigger.dev/p/python-support-2

You can upvote for python support to make it happen 😍

+1 this would be awesome .. just upvoted!

Here is the list that I want to use in my project. Many of these libraries I find very useful in any project:

Asynchronous and HTTP Requests

aiohttp: Asynchronous HTTP client and server for Python.
async-timeout: Manage timeouts in asynchronous operations.
httpx: Asynchronous HTTP requests, an alternative to aiohttp.
websocket-client: For implementing WebSocket connections.

Data Processing

pandas: Data analysis and manipulation (e.g., checklists, tasks, statuses).
numpy: Mathematical computations.
sqlalchemy: ORM for database operations and queries.
pydantic: Data validation.
pydantic_core: Core utilities for Pydantic.
jsonschema: JSON structure validation.
jsonschema_specifications: Specifications for JSON schema validation.
pyyaml: Work with YAML for configurations and templates.
pytz: Handle time zones.
python-dateutil: Work with dates and time-related calculations.
s3fs: Work with AWS S3 file systems.
smart_open: Work with cloud-based files.

Text and Query Handling

spaCy: NLP library for parsing queries, extracting keywords, and entities.
nltk: Natural Language Processing (e.g., syntax analysis and tokenization).
textblob: Simple tool for text analysis.
regex: Regular expressions for advanced text parsing.
pyparsing: Text parsing library.
text-unidecode: Decode text.
ujson: Fast serialization and deserialization of JSON.

Reporting and Visualization

Pillow: Work with images (e.g., before/after photos).
imageio: Load and save images.
tabulate: Format data into tables.
matplotlib: Create graphs and charts.
reportlab / fpdf: Automatically generate PDFs for reports and results.
jinja2: Generate HTML templates for reports.
openpyxl: Save checklists or reports in Excel format.
xlrd: Work with Excel files.
xlwt: Create Excel 97/2000 files.
asciitree: Generate tree-like text structures.

Parsing and Web Data

html5lib: Parse HTML.
soupsieve: Search within HTML documents.
lxml: Parse XML/HTML.
webencodings: Work with text encodings.

Infrastructure and Utilities

docker: For deploying the project in containers.
boto3: Work with AWS, including S3 and other services.
logging: Standard library for detailed logging of events.
cryptography: Tools for encrypting data.
tomli: Read TOML files.

Additional

charset-normalizer: Detect text encodings.
nh3: Generate HTML.
zipp: Work with archives.
sqlparse: Parse SQL statements.
xarray: Analyze multidimensional arrays.

Please give the #1686 PR a try!
We need testers.

In version 3+, we now have a Python extension

Navigation Menu

Repository navigation

[TRI-1882] Python support #862

Asynchronous and HTTP Requests

Data Processing

Text and Query Handling

Reporting and Visualization

Parsing and Web Data

Infrastructure and Utilities

Additional

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

[TRI-1882] Python support #862

Description

Activity

matt-aitken commented on Jan 20, 2024

listenaddress commented on Feb 28, 2024

wesleymatosdev commented on Jul 12, 2024

MaleicAcid commented on Sep 19, 2024

montaign commented on Oct 1, 2024

LeEricCH commented on Oct 1, 2024

chanmathew commented on Oct 3, 2024

tgirotto commented on Oct 3, 2024

nullmastermind commented on Oct 8, 2024

archodev commented on Oct 8, 2024

saschaseniuk commented on Oct 9, 2024

BaileySimrell commented on Dec 11, 2024

peter-hanzo commented on Dec 19, 2024

Asynchronous and HTTP Requests

Data Processing

Text and Query Handling

Reporting and Visualization

Parsing and Web Data

Infrastructure and Utilities

Additional

zvictor commented on Feb 9, 2025

matt-aitken commented on Apr 2, 2025

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions