AmosLewis c199ac78eb Add decompose of aten._scaled_dot_product_flash_attention.default ...

The new decompose was just implemented from pytorch thes day.
Here is pytorch pr: https://github.com/pytorch/pytorch/pull/117390
This decompose is required from lowering chatglm model in torch-mlir.
Here is the issue:https://github.com/llvm/torch-mlir/issues/2730

2024-01-16 03:03:14 +00:00

..

dynamo_backend

Make the tensors contiguous.

2023-06-26 17:29:54 +05:30

examples

Add --additional_runtime_args option and use in OPT example. (#1855)

2023-10-19 13:29:39 -05:00

iree_utils

Relocate quantized matmul reassociation flag (#2047)

2023-12-20 12:48:40 -08:00

shark_eager

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

tests

#1843 - Add Export Default settings button (#2016)

2023-12-06 14:58:17 -06:00

__init__.py

Add the shark compile downstream due to https://github.com/pytorch/pytorch/pull/104185#issuecomment-1615110613 (#1615)

2023-07-01 08:30:58 -07:00

backward_makefx.py

Minor fixes for MiniLM Training

2023-07-18 17:16:44 +05:30

iree_eager_backend.py

[SharkInference] Make SharkInference compile the entire module (#708)

2023-01-03 23:25:23 +05:30

model_annotation.py

Revert "Re-enable SD tunings without matmuls. (#1976)" (#1979)

2023-11-17 23:44:33 +05:30

parser.py

Add --additional_runtime_args option and use in OPT example. (#1855)

2023-10-19 13:29:39 -05:00

shark_benchmark_runner.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

shark_compile.py

Update brevitas quant api (#1975)

2023-11-15 10:04:07 -08:00

shark_downloader.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

shark_generate_model_config.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

shark_importer.py

Add decompose of aten._scaled_dot_product_flash_attention.default

2024-01-16 03:03:14 +00:00

shark_inference.py

Add sharded Falcon support

2023-10-26 21:53:25 +05:30

shark_runner.py

Add sharded Falcon support

2023-10-26 21:53:25 +05:30

shark_trainer.py

Switch most compile flows to use ireec.compile_file. (#1863)

2023-10-06 23:04:43 -05:00

stress_test.py

Fix concurrency issue in stress_test for CUDA devices

2022-12-22 08:54:19 -08:00

tflite_utils.py

Remove tf package dep for SharkDownloader tflite tests (#212)

2022-07-26 12:41:12 -07:00

torch_mlir_lockstep_tensor.py

[Lockstep] Hack to avoid aten._reshape_alias (#332)

2022-09-22 18:02:09 -04:00

torch_mlir_utils.py

Add mlir_type for torch_model_list.csv (#1428)

2023-05-15 10:23:54 -07:00