Comments on: How to Invoke Complex Web Services http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/ thoughts about all things "real time" that revolve around "ETL" (Extract, Transform, Load) and Data Integration Thu, 29 Oct 2009 09:32:23 +0000 http://wordpress.com/ hourly 1 By: dsrealtime http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-729 dsrealtime Fri, 31 Jul 2009 20:30:52 +0000 http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-729 It can be done, but it is not particularly easy. The WSTransformer has the ability to pass a header, but it has to be in the absolutely correct format, and namespaces have to right..... the best way to approach it would be to use some separate testing tool (Actional, SOAPscope from Mindreef, etc.) and formally capture a "working" SOAP envelope and header. Then you will be able to tell what you need to build and send. It gets more difficult than that, because you may also have to custom craft the details of the SOAP body, and then do the same with the response and any other queries/commands you may be issuing. WSTransformer is best for single row, stateless and no-session invocations that return a transformed result. If you need to do complex processing it is best to put it together in a java client and invoke via the Java Transformer. In the java client you will have all the control that you need, and can more easily unit test it outside of DS and then include in DS for integration testing once you know how Java Pack works. Ernie It can be done, but it is not particularly easy. The WSTransformer has the ability to pass a header, but it has to be in the absolutely correct format, and namespaces have to right….. the best way to approach it would be to use some separate testing tool (Actional, SOAPscope from Mindreef, etc.) and formally capture a “working” SOAP envelope and header. Then you will be able to tell what you need to build and send. It gets more difficult than that, because you may also have to custom craft the details of the SOAP body, and then do the same with the response and any other queries/commands you may be issuing. WSTransformer is best for single row, stateless and no-session invocations that return a transformed result. If you need to do complex processing it is best to put it together in a java client and invoke via the Java Transformer. In the java client you will have all the control that you need, and can more easily unit test it outside of DS and then include in DS for integration testing once you know how Java Pack works.

Ernie

]]> By: Anu http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-728 Anu Fri, 31 Jul 2009 18:03:20 +0000 http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-728 Hi, We have been reading your articles Datastage webservices and they have been very helpful. I have a doubt, was wondering if you can help us. We need to connect Datastage 8.0 to an application via a URL by passing username and password in the HTTP headers. This application will return the cookie and a session Id within the cookie. This session Id should be captured for further transactions. Now we imported the WSDL published by this application and created a Webservices Tranformer Stage but have not been able to figure out on how to pass the username and passwd in the HTTP header to connect with this app? Any help? Hi,
We have been reading your articles Datastage webservices and they have been very helpful. I have a doubt, was wondering if you can help us.
We need to connect Datastage 8.0 to an application via a URL by passing username and password in the HTTP headers. This application will return the cookie and a session Id within the cookie. This session Id should be captured for further transactions.
Now we imported the WSDL published by this application and created a Webservices Tranformer Stage but have not been able to figure out on how to pass the username and passwd in the HTTP header to connect with this app? Any help?

]]> By: Heartburn Home Remedy http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-640 Heartburn Home Remedy Wed, 15 Apr 2009 11:44:45 +0000 http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-640 Not that I'm totally impressed, but this is more than I expected for when I stumpled upon a link on Digg telling that the info is quite decent. Thanks. Not that I’m totally impressed, but this is more than I expected for when I stumpled upon a link on Digg telling that the info is quite decent. Thanks.

]]> By: dsrealtime http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-527 dsrealtime Wed, 10 Sep 2008 01:12:33 +0000 http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-527 Venu ... You should have received the .dsx from me with the solution. Not sure exactly what was thwarting you in your installation, but as we discussed, there are a variety of solutions. For everyone else, it appeared to be a namespace issue. In my 8.x with FP1, I was able to read the documents just fine, but if there are issues and you are reading XML to put into an rdbms or other target, there are lots of shortcuts to get you moving....the easiest is to just pass your xml string thru a Transformer and edit out the offending namespace prefixes. You can't always do that, but very often, especially if you are just shredding the document anyway, it will be fine. DataStage has rich text functions, especially in the BASIC Transformer or Server Jobs, that can manipulate lengthy text strings, with eReplace being one of my favorites. Ernie Venu …

You should have received the .dsx from me with the solution. Not sure exactly what was thwarting you in your installation, but as we discussed, there are a variety of solutions. For everyone else, it appeared to be a namespace issue. In my 8.x with FP1, I was able to read the documents just fine, but if there are issues and you are reading XML to put into an rdbms or other target, there are lots of shortcuts to get you moving….the easiest is to just pass your xml string thru a Transformer and edit out the offending namespace prefixes. You can’t always do that, but very often, especially if you are just shredding the document anyway, it will be fine. DataStage has rich text functions, especially in the BASIC Transformer or Server Jobs, that can manipulate lengthy text strings, with eReplace being one of my favorites.

Ernie

]]> By: venu http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-521 venu Sat, 23 Aug 2008 09:08:09 +0000 http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-521 My gmail id is : gopalopposite@gmail.com My gmail id is : gopalopposite@gmail.com

]]> By: venu http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-520 venu Sat, 23 Aug 2008 08:48:08 +0000 http://dsrealtime.wordpress.com/2008/04/12/how-to-invoke-complex-web-services/#comment-520 Hi, while im process an Embedded XML. A SOAP envelope in datastage im getting below error please adivise xml_job1..XML_Input_0: Xalan fatal error (publicId: , systemId: , line: 0, column: 0): An exception occurred! Type:NetAccessorException, Message:Could not connect to the socket for URL '{0}'. Error={1} xml_job1..XML_Input_0: Xalan fatal error (publicId: , systemId: , line: 1, column: 230): Fatal error encountered during schema scan Hi,
while im process an Embedded XML. A SOAP envelope in datastage im getting below error please adivise
xml_job1..XML_Input_0: Xalan fatal error (publicId: , systemId: , line: 0, column: 0): An exception occurred! Type:NetAccessorException, Message:Could not connect to the socket for URL ‘{0}’. Error={1}

xml_job1..XML_Input_0: Xalan fatal error (publicId: , systemId: , line: 1, column: 230): Fatal error encountered during schema scan

]]>