How can I use Azure Stream Analytics to use an on-premise SQL Server as an Output?
I'm following the instructions to set up App Insights to spool to SQL using Azure Stream Analytics, but I'm trying to deviate slightly to use an on-premise SQL server (that the web application already uses) over VPN.
At the point of adding the output, this is failing with:
Is it the case that IP addresses are not supported, or is it something more fundamental than that?
azure azure-application-insights azure-stream-analytics asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
add a comment |
I'm following the instructions to set up App Insights to spool to SQL using Azure Stream Analytics, but I'm trying to deviate slightly to use an on-premise SQL server (that the web application already uses) over VPN.
At the point of adding the output, this is failing with:
Is it the case that IP addresses are not supported, or is it something more fundamental than that?
azure azure-application-insights azure-stream-analytics asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
add a comment |
I'm following the instructions to set up App Insights to spool to SQL using Azure Stream Analytics, but I'm trying to deviate slightly to use an on-premise SQL server (that the web application already uses) over VPN.
At the point of adding the output, this is failing with:
Is it the case that IP addresses are not supported, or is it something more fundamental than that?
azure azure-application-insights azure-stream-analytics asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
I'm following the instructions to set up App Insights to spool to SQL using Azure Stream Analytics, but I'm trying to deviate slightly to use an on-premise SQL server (that the web application already uses) over VPN.
At the point of adding the output, this is failing with:
Is it the case that IP addresses are not supported, or is it something more fundamental than that?
azure azure-application-insights azure-stream-analytics azure azure-application-insights azure-stream-analytics asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
asked Nov 26 '18 at 9:22
Rowland ShawRowland Shaw
32.6k1283149
32.6k1283149
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
You are probably looking for answers directly to your question, which Jean-Sébastien answers succinctly. But an alternative architecture, if you haven't considered it already...
You could stream to a transient Azure SQL Database or Blob storage (likely cheaper depending on your workload), and then use Azure Data Factory tunnelled via a Self-Hosted Data Factory Integration Runtime to "send" the data back to on-premise SQL.
Data Factory V2 also has blob triggers, so rather than needing a schedule it could pickup any new blobs in micro batches.
I say "send" in quotation marks as the Integration Runtime actually creates an outgoing connection to from on-premise to Azure, yet gives the capability for push-like data transfer.
If data factory proves useful, here is a guide creating copy pipelines: https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-portal
Albeit this guide is for on-prem sql to blob, but it gives you a stronger starting point.
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
add a comment |
At this time only Azure SQL Databases are supported in Azure Stream Analytics.
Sorry for the inconvenience.
Thanks,
JS (Azure Stream Analytics)
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53477986%2fhow-can-i-use-azure-stream-analytics-to-use-an-on-premise-sql-server-as-an-outpu%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
You are probably looking for answers directly to your question, which Jean-Sébastien answers succinctly. But an alternative architecture, if you haven't considered it already...
You could stream to a transient Azure SQL Database or Blob storage (likely cheaper depending on your workload), and then use Azure Data Factory tunnelled via a Self-Hosted Data Factory Integration Runtime to "send" the data back to on-premise SQL.
Data Factory V2 also has blob triggers, so rather than needing a schedule it could pickup any new blobs in micro batches.
I say "send" in quotation marks as the Integration Runtime actually creates an outgoing connection to from on-premise to Azure, yet gives the capability for push-like data transfer.
If data factory proves useful, here is a guide creating copy pipelines: https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-portal
Albeit this guide is for on-prem sql to blob, but it gives you a stronger starting point.
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
add a comment |
You are probably looking for answers directly to your question, which Jean-Sébastien answers succinctly. But an alternative architecture, if you haven't considered it already...
You could stream to a transient Azure SQL Database or Blob storage (likely cheaper depending on your workload), and then use Azure Data Factory tunnelled via a Self-Hosted Data Factory Integration Runtime to "send" the data back to on-premise SQL.
Data Factory V2 also has blob triggers, so rather than needing a schedule it could pickup any new blobs in micro batches.
I say "send" in quotation marks as the Integration Runtime actually creates an outgoing connection to from on-premise to Azure, yet gives the capability for push-like data transfer.
If data factory proves useful, here is a guide creating copy pipelines: https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-portal
Albeit this guide is for on-prem sql to blob, but it gives you a stronger starting point.
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
add a comment |
You are probably looking for answers directly to your question, which Jean-Sébastien answers succinctly. But an alternative architecture, if you haven't considered it already...
You could stream to a transient Azure SQL Database or Blob storage (likely cheaper depending on your workload), and then use Azure Data Factory tunnelled via a Self-Hosted Data Factory Integration Runtime to "send" the data back to on-premise SQL.
Data Factory V2 also has blob triggers, so rather than needing a schedule it could pickup any new blobs in micro batches.
I say "send" in quotation marks as the Integration Runtime actually creates an outgoing connection to from on-premise to Azure, yet gives the capability for push-like data transfer.
If data factory proves useful, here is a guide creating copy pipelines: https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-portal
Albeit this guide is for on-prem sql to blob, but it gives you a stronger starting point.
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
You are probably looking for answers directly to your question, which Jean-Sébastien answers succinctly. But an alternative architecture, if you haven't considered it already...
You could stream to a transient Azure SQL Database or Blob storage (likely cheaper depending on your workload), and then use Azure Data Factory tunnelled via a Self-Hosted Data Factory Integration Runtime to "send" the data back to on-premise SQL.
Data Factory V2 also has blob triggers, so rather than needing a schedule it could pickup any new blobs in micro batches.
I say "send" in quotation marks as the Integration Runtime actually creates an outgoing connection to from on-premise to Azure, yet gives the capability for push-like data transfer.
If data factory proves useful, here is a guide creating copy pipelines: https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-portal
Albeit this guide is for on-prem sql to blob, but it gives you a stronger starting point.
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
edited Nov 27 '18 at 11:04
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
answered Nov 26 '18 at 22:31
Alex KeySmithAlex KeySmith
10.5k450119
10.5k450119
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
add a comment |
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
I've already got the data going to blob storage so I just need to work out how to get it to stream to my on-premise database, so this at least gives a starting point, even if that guide is a little vague
– Rowland Shaw
Nov 27 '18 at 11:01
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
Hi @RowlandShaw I've edited my answer to add a guide for copying between data stores. If you haven't used data factory before I'd recommend starting at the overview page, as there are gems in the data factory documentation as you move around it.
– Alex KeySmith
Nov 27 '18 at 11:05
add a comment |
At this time only Azure SQL Databases are supported in Azure Stream Analytics.
Sorry for the inconvenience.
Thanks,
JS (Azure Stream Analytics)
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
add a comment |
At this time only Azure SQL Databases are supported in Azure Stream Analytics.
Sorry for the inconvenience.
Thanks,
JS (Azure Stream Analytics)
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
add a comment |
At this time only Azure SQL Databases are supported in Azure Stream Analytics.
Sorry for the inconvenience.
Thanks,
JS (Azure Stream Analytics)
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
At this time only Azure SQL Databases are supported in Azure Stream Analytics.
Sorry for the inconvenience.
Thanks,
JS (Azure Stream Analytics)
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
edited Nov 26 '18 at 19:31
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
answered Nov 26 '18 at 18:47
Jean-SébastienJean-Sébastien
55227
55227
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
add a comment |
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
My end goal here is to create a Power BI report that combines Application Insights data with data from an on-premise database, and it seems I'm hitting brick walls at every turn. It's a shame @AzureSupport and the documentation didn't just tell me that when I first started poking them last Thursday :(
– Rowland Shaw
Nov 27 '18 at 9:18
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
Sorry for this, let me talk to the team to improve the documentation on the ASA side. To connect local sources to PowerBI, did you try the "On Premises Gateway" docs.microsoft.com/en-us/power-bi/service-gateway-onprem
– Jean-Sébastien
Nov 28 '18 at 20:55
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53477986%2fhow-can-i-use-azure-stream-analytics-to-use-an-on-premise-sql-server-as-an-outpu%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
