generated from AzulGarza/python-project-template
-
-
Notifications
You must be signed in to change notification settings - Fork 56
Open
Description
Chronos models in TimeCopilot currently default to bfloat16.
timecopilot/timecopilot/models/foundation/chronos.py
Lines 90 to 95 in eb97165
| device_map = "cuda:0" if torch.cuda.is_available() else "cpu" | |
| model = BaseChronosPipeline.from_pretrained( | |
| self.repo_id, | |
| device_map=device_map, | |
| torch_dtype=torch.bfloat16, | |
| ) |
In many cases, this has the potential of causing precision issues. For example, see this PR from time-bench. Just changing the dtype to float32 changes the position of the model from the 5th place to the 1st in terms of the MASE. We recommend changing the default dtype for Chronos models to float32 in TimeCopilot.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels