Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .ci/python-keras-scoring.yml
Original file line number Diff line number Diff line change
Expand Up @@ -103,4 +103,4 @@ jobs:
fieldMappings: |
Description=Branch: Branch $(Build.SourceBranch) failed to build. Go to Boards>WorkItems and tag the failure type.
displayName: 'Create work item on failure'
condition: failed()
condition: failed()
2 changes: 1 addition & 1 deletion .ci/python-ml-scoring.yml
Original file line number Diff line number Diff line change
Expand Up @@ -68,4 +68,4 @@ jobs:
fieldMappings: |
Description=Branch: Branch $(Build.SourceBranch) failed to build. Go to Boards>WorkItems and tag the failure type.
displayName: 'Create work item on failure'
condition: failed()
condition: failed()
2 changes: 1 addition & 1 deletion .ci/python-ml-training.yml
Original file line number Diff line number Diff line change
Expand Up @@ -115,4 +115,4 @@ jobs:
fieldMappings: |
Description=Branch: Branch $(Build.SourceBranch) failed to build. Go to Boards>WorkItems and tag the failure type.
displayName: 'Create work item on failure'
condition: failed()
condition: failed()
1 change: 0 additions & 1 deletion .ci/realtime-serving-dl-dev.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

# Starter pipeline
# Start with a minimal pipeline that you can customize to build and deploy your code.
# Add steps that build, run tests, deploy, and more:
Expand Down
2 changes: 1 addition & 1 deletion .ci/scripts/SetResource.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -79,4 +79,4 @@ $clusterResources = Get-AzResource -ResourceType "Microsoft.ContainerService/man
foreach($cluster in $clusterResources)
{
Update-GroupResources -resGroup $cluster.Properties.nodeResourceGroup -tags $projectTags
}
}
2 changes: 0 additions & 2 deletions .ci/steps/DLAKSDeployAMLJob.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@


parameters:
azureSubscription: ''
azure_subscription: ''
Expand Down
3 changes: 0 additions & 3 deletions .ci/steps/MLAKSDeployAMLJob.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@


parameters:
azureSubscription: ''
azure_subscription: ''
Expand Down Expand Up @@ -93,4 +91,3 @@ steps:
conda: ${{parameters.conda}}
azureresourcegroup: ${{parameters.azureresourcegroup}}
doCleanup: ${{parameters.doCleanup}}

1 change: 0 additions & 1 deletion .ci/steps/MLBatchDeployAMLJob.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

parameters:
azureSubscription: ''
azure_subscription: ''
Expand Down
1 change: 0 additions & 1 deletion .ci/steps/RecoPySparkRTS.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

parameters:
azureSubscription: ''
azure_subscription: ''
Expand Down
2 changes: 0 additions & 2 deletions .ci/steps/az-ml-realtime-score.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@


parameters:
azureSubscription: ''
azure_subscription: ''
Expand Down
2 changes: 0 additions & 2 deletions .ci/steps/azpapermill.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@


parameters:
notebook: 01_DataPrep.ipynb # defaults for any parameters that aren't specified
location: "x"
Expand Down
2 changes: 0 additions & 2 deletions .ci/steps/azpapermill_iterator.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@


parameters:
notebooks: 01_DataPrep.ipynb # defaults for any parameters that aren't specified
location: "x"
Expand Down
1 change: 0 additions & 1 deletion .ci/steps/azure_r.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

parameters:
notebook: # defaults for any parameters that aren't specified
location: "."
Expand Down
1 change: 0 additions & 1 deletion .ci/steps/bash_r.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

parameters:
notebook: # defaults for any parameters that aren't specified
location: "."
Expand Down
1 change: 0 additions & 1 deletion .ci/steps/cleanuptask.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,4 +22,3 @@ steps:
echo Project resource group did not exist
fi
echo Done Cleanup

2 changes: 0 additions & 2 deletions .ci/steps/config_conda.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

parameters:
conda_location: .
azureSubscription: #
Expand Down Expand Up @@ -105,4 +104,3 @@ steps:

pip install -U "azureml-core<0.1.5" "azureml-contrib-services<0.1.5" "azureml-pipeline<0.1.5" \
--extra-index-url https://azuremlsdktestpypi.azureedge.net/sdk-release/master/588E708E0DF342C4A80BD954289657CF

1 change: 0 additions & 1 deletion .ci/steps/deploy_rts.yml
Original file line number Diff line number Diff line change
Expand Up @@ -108,4 +108,3 @@ steps:
location: ${{parameters.location}}
azureSubscription: ${{parameters.azureSubscription}}
conda: ${{parameters.conda}}

1 change: 0 additions & 1 deletion .ci/steps/deploy_steps.yml
Original file line number Diff line number Diff line change
Expand Up @@ -73,4 +73,3 @@ steps:
ScriptArguments: '-resourceGroupName ''${{parameters.azureresourcegroup}}'' -tagId ''deployment-id'' -deploymentId ''${{parameters.deploymentguidtag}}'''
azurePowerShellVersion: 'LatestVersion'
displayName: 'Tag All Resources'

1 change: 0 additions & 1 deletion .ci/steps/deploy_steps_v2.yml
Original file line number Diff line number Diff line change
Expand Up @@ -85,4 +85,3 @@ steps:
ScriptArguments: '-resourceGroupName ''${{parameters.azureresourcegroup}}'' -tagId ''deployment-id'' -deploymentId ''${{parameters.deploymentguidtag}}'''
azurePowerShellVersion: 'LatestVersion'
displayName: 'Tag All Resources'

1 change: 0 additions & 1 deletion .ci/steps/docker_clean_step.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

steps:
- script: |
docker stop $(docker ps -a -q)
Expand Down
2 changes: 0 additions & 2 deletions .ci/steps/papermill.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@


parameters:
notebook: 01_DataPrep.ipynb # defaults for any parameters that aren't specified
location: "{{cookiecutter.project_name}}"
Expand Down
2 changes: 1 addition & 1 deletion .ci/steps/reco_conda_clean_win.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,4 +17,4 @@ steps:
del /q /S %LOCALAPPDATA%\Temp\*
for /d %%i in (%LOCALAPPDATA%\Temp\*) do @rmdir /s /q "%%i"
displayName: 'Remove Temp Files'
condition: succeededOrFailed()
condition: succeededOrFailed()
1 change: 0 additions & 1 deletion .ci/steps/shorten_string.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

parameters:
Input_String: ""
Output_Variable: ""
Expand Down
2 changes: 1 addition & 1 deletion .docs/python_scoring.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,4 @@
<img width="800" src="../images/decision_python_scoring.png">
</p>

When deploying ML models in Python there are two core questions. The first is will it be real time and whether the model is a deep learning model. For deploying deep learning models that require real time we recommend Azure Kubernetes Services (AKS) with GPUs. For a tutorial on how to do that look at [AKS w/GPU](https://github.com/Microsoft/AKSDeploymentTutorialAML). For deploying deep learning models for batch scoring we recommend using AzureML pipelines with GPUs, for a tutorial on how to do that look [AzureML Pipelines w/GPU](https://github.com/Azure/Batch-Scoring-Deep-Learning-Models-With-AML). For non deep learning models we recommend you use the same services but without GPUs. For a tutorial on deploying classical ML models for real time scoring look [AKS](https://github.com/Microsoft/MLAKSDeployAML) and for batch scoring [AzureML Pipelines](https://github.com/Microsoft/AMLBatchScoringPipeline)
When deploying ML models in Python there are two core questions. The first is will it be real time and whether the model is a deep learning model. For deploying deep learning models that require real time we recommend Azure Kubernetes Services (AKS) with GPUs. For a tutorial on how to do that look at [AKS w/GPU](https://github.com/Microsoft/AKSDeploymentTutorialAML). For deploying deep learning models for batch scoring we recommend using AzureML pipelines with GPUs, for a tutorial on how to do that look [AzureML Pipelines w/GPU](https://github.com/Azure/Batch-Scoring-Deep-Learning-Models-With-AML). For non deep learning models we recommend you use the same services but without GPUs. For a tutorial on deploying classical ML models for real time scoring look [AKS](https://github.com/Microsoft/MLAKSDeployAML) and for batch scoring [AzureML Pipelines](https://github.com/Microsoft/AMLBatchScoringPipeline)
2 changes: 1 addition & 1 deletion .docs/python_training.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,4 +7,4 @@
There are many options for training ML models in Python on Azure. The most straight forward way is to train your model on a [DSVM](https://azure.microsoft.com/en-us/services/virtual-machines/data-science-virtual-machines/). You can either do this in local model straight on the VM or through attaching it in AzureML as a compute target. If you want to have AzureML manage the compute for you and scale it up and down based on whether jobs are waiting in the queue then you should AzureML Compute.

Now if you are going to run multiple jobs for hyperparameter tuning or other purposes then we would recommend using [Hyperdrive](https://docs.microsoft.com/en-us/azure/machine-learning/service/how-to-tune-hyperparameters), [Azure automated ML](https://docs.microsoft.com/en-us/azure/machine-learning/service/concept-automated-ml) or AzureML Compute dependent on your requirements.
For a tutorial on how to use Hyperdrive go [here](https://github.com/Microsoft/MLHyperparameterTuning).
For a tutorial on how to use Hyperdrive go [here](https://github.com/Microsoft/MLHyperparameterTuning).
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/scenario_request.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@ assignees: ''
### Reasons for scenario
<!--- Outline core reasons why the scenario should be covered -->

### Other Comments
### Other Comments
Binary file modified .images/decision_python_scoring.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
2 changes: 1 addition & 1 deletion .images/demo.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified .images/python_training_diag.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions LICENSE
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
MIT License
MIT License

Copyright (c) Microsoft Corporation. All rights reserved.

Expand All @@ -18,4 +18,4 @@
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE
SOFTWARE
1 change: 1 addition & 0 deletions ML-For-Beginners
Submodule ML-For-Beginners added at f925c9
1 change: 0 additions & 1 deletion ai200-architectures/TrainDistributedDeepModel
Submodule TrainDistributedDeepModel deleted from d037c5
Loading