Instructions to use kernels-community/flash-attn2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/flash-attn2 with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/flash-attn2") - Notebooks
- Google Colab
- Kaggle
| .bak | |
| __pycache__ | |
| build-ext | |
| cmake | |
| result | |
| CMakeLists.txt | |
| setup.py | |
| pyproject.toml | |
| .venv | |
| torch-ext/registration.h | |
| torch-ext/flash_attn/*.so | |
| torch-ext/flash_attn/_ops.py |