Quantcast
Channel: Microsoft SQL Server Community Samples: Integration Services
Viewing all 582 articles
Browse latest View live
↧

New Post: Setting Execute SQL Task Connection Manager

February 13, 2013, 1:32 am
$
0
0
Hi,
How is setting execute SQL task connection manager supposed to be done using EzAPI? Setting the Connection property to an EzOleDbConnectionManager throws a NullReferenceException that originates from the EzExecuteSqlTask.ParameterBindings property.

Someone in this blog has been wondering the same a long time ago.
↧
Search

New Post: Setting Execute SQL Task Connection Manager

February 13, 2013, 4:07 am
$
0
0
I found out what's wrong. The EzExecuteSqlTask's Connection property's setter is actually incorrectly coded. Current implementation is as follows.
public EzConnectionManager Connection
{
    get { return m_connection; }
    set 
    {
        if (value == null)
        {
            throw new ArgumentNullException("Connection value");
        }
        if (value.CM.CreationName != "OLEDB")
        {
            throw new IncorrectAssignException(string.Format("Cannot assign {0} connection to EzExecSqlTask", value.CM.CreationName));
        }
        (host.InnerObject as ExecuteSQLTask).Connection = value.Name;
        m_connection = value;
    }
}
The problem is with the line 
(host.InnerObject as ExecuteSQLTask).Connection = value.Name;
First of all the cast can't be done that way (and shouldn't since NullReferenceException will be thrown and it isn't dealt with). Secondly the line should be (or similar)
host.Properties["Connection"].SetValue(host, value.Name);
↧
↧

New Comment on "SharePoint List Adapters"

February 13, 2013, 5:17 am
$
0
0
Is there any sample code of dynamically creating a CAML query using an expression - for example to pass in a "last-run" date to use for incremental loads?
↧

New Post: How do I import Large Lists with SharePoint List Source adapter?

February 19, 2013, 8:28 am
$
0
0
Having issues trying to import a large SP list approx 7500 rows; I get the error, "Microsoft.Samples.SqlServer.SSIS.SharePointUtility.SharePointUnhandledException: Unspecified SharePoint Error. A possible reason might be you are trying to retrieve too many items at a time (Batch size)"
I have tried different batch sizes. Its currently down to 100 and I only have 8 - 10 columns.
As a test, I set up a filtered view on an index column and was able to import all 2000 rows from that view without issue. I'm sure it may be simple, but I can't put my finger on it.

Thanks,
↧

New Post: Error in SharePoint List Destination: System.InvalidOperationException: Duplicate attribute

February 26, 2013, 11:00 am
$
0
0
Hi All,

I am currently utilizing the SharePoint List Destination component in my SSIS package to transfer metadata to a SharePoint list. However, I am currently getting this error when I run my package:

[Update Sharepoint Metadata [4281]]
Error: System.InvalidOperationException: Duplicate attribute.
at System.Xml.Linq.XElement.AddAttributeSkipNotify(XAttribute a)
at System.Xml.Linq.XContainer.AddContentSkipNotify(Object content)
at System.Xml.Linq.XContainer.AddContentSkipNotify(Object content)
at System.Xml.Linq.XContainer.Add(Object content)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter._Closure$__7._Lambda$__63(XElement row)
at System.Linq.Enumerable.WhereSelectEnumerableIterator2.MoveNext()
at System.Linq.Enumerable.<UnionIterator>d__811.MoveNext()
at System.Linq.Enumerable.WhereSelectEnumerableIterator2.MoveNext()
at System.Xml.Linq.XContainer.AddContentSkipNotify(Object content)
at System.Xml.Linq.XContainer.Add(Object content)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.ExecuteSharePointUpdateBatch(String listName, String viewId, XElement batchXml, Int16 batchSize)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.UpdateListItems(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName, IEnumerable1 fieldValueList, Int16 batchSize)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListDestination.ProcessInput(Int32 inputID, PipelineBuffer buffer)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper90 wrapper, Int32 inputID, IDTSBuffer90 pDTSBuffer, IntPtr bufferWirePacket)

Appreciate your kind assistance on this matter. Thanks a lot! :)
↧
↧

New Post: Anyone figure this out with Sharepoint Online/Office 365?

February 26, 2013, 4:17 pm
$
0
0
I'm stuck here as well. I am sending text files to a doc library in 365 via email and need to pull the files down into SSIS for ETL processing..... keep getting the FORBIDDEN error 403.
Has anyone made any progress on this front?
↧

Commented Issue: SP List - Need support for O365 Claims Authentication [19231]

February 26, 2013, 4:41 pm
$
0
0
Found this relevant Url http://ksmuraleedharan.blogspot.com/2011/10/accessing-web-service-in-sharepoint.html

This might be already addressed with a different checkin, I need to verify.
Comments: ** Comment from web user: Skutr **

Downloaded Beta 1/28/2013, installed and now get 401 Unauthorized error trying to access O365 Sharepoint. In prior relase was getting 403 Forbidden errors. So, no change, I think?

↧

New Post: SharePoint List Source not returning records

February 27, 2013, 12:06 am
$
0
0
I have the same problem too, no error but no data is read. I have put the farm admin user and password in the connection manager but I am running the package from BIDS installed on the sql server while logged in with another account. There aren't any item-level premissions. This message shows in the progress tab.

[SharePoint List Source] Information: Loaded 0 records from list 'listname' at 'url'. Elapsed time is 190ms

any suggestions ?
↧
Search

New Post: System.ServiceModel.FaultException: Exception of type 'Microsoft.SharePoint.SoapServer.SoapServerException' was thrown.

February 27, 2013, 1:58 am
$
0
0
When querying a SharePoint list using the SharePoint List Adapter in SSIS, I get the following message:

Error: 0xC0047062 at SharepointDocument Population Staging, SharePoint List Source [4444]: Microsoft.Samples.SqlServer.SSIS.SharePointUtility.SharePointUnhandledException: Unspecified SharePoint Error. A possible reason might be you are trying to retrieve too many items at a time (Batch size) ---> System.ServiceModel.FaultException: Exception of type 'Microsoft.SharePoint.SoapServer.SoapServerException' was thrown.

It would be nice to be able to see the InnerException detail here, is that possible?

Thanks,

Ken
↧
↧

Created Issue: Buffer error appearing in SharePoint List Source for one SiteURL [19409]

February 28, 2013, 9:04 am
$
0
0
I am applying the SharePoint List Source adapter in an SSIS package running under SQL Server 2008 R2. In this package the SharePoint List Source is located in a loop in which I am passing to it a Site List Name, Site List View Name, and a Site URL for nearly 30 different SharePoint sites. These are provided from a table, which are pulled from a SQL Task and provided to an expression applied by the SharePoint List Source. This works great for all but one of the sites, where the following error is returned.


[SharePoint List Source [1]] Error: Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.
at Microsoft.SqlServer.Dts.Pipeline.PipelineBuffer.SetString(Int32 columnIndex, String value)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)


The number of sites being read from the table does not make any difference, the error appears for the same site even when it is the only one being read by the SSIS package.

I noticed in the Data Flow that is stops at 150 records with the problem site. Other sites are pulling more records, so I don't know if this is an issue. Also, I ran a test in which I hardcoded in the SiteListName, SiteListViewName and SiteURL for the problem site under the Component Properties tab. It connected with no problem and displayed the SharePoint fields under Column Mappings. I tried the most recent beta version of this adapter with the same error result listed above. I also tried filtering down the result set using a CamlQuery, which made the process run faster, but the same error still takes place.

Any ideas how to work around this buffer issue?

Thanks
↧

Reviewed: SharePoint List Source and Destination (Mar 06, 2013)

March 6, 2013, 3:46 am
$
0
0
Rated 5 Stars (out of 5) - If you get an error installing your package on your deployment server then check that this file exists C:\Program Files\Microsoft SQL Server\100\DTS\PipelineComponents\SharePointListAdapters.dll For me it failed to install so I created an Administrator command prompt and re-ran the installation and this time it worked. David Bridge www.davidbridgetechnology.com http://davidbridge.wordpress.com
↧

New Post: How do I import Large Lists with SharePoint List Source adapter?

March 7, 2013, 6:53 am
$
0
0
I don't know the answer to your question but the lists I have been bringing out atr 21 columns and 150,000 rows with a batch of 1,000 and the adapter coped fine.

It brought 355K rows in 34 minutes

Dave
↧

New Post: The HTTP request is unauthorized with client authentication scheme 'Ntlm'

March 7, 2013, 7:46 pm
$
0
0
I am using the SharePoint source list adapter and when I try to connect to any list in SharePoint 2007, I got 401 error. This happens in both designer and SQL Agent, and I am sure that my account and the SQL agent account has permission to the SharePoint list.
It works with all other Web Applications within the farm, but fail for all sites within this particular webapp that I need data from. All webapp in the farm are using Windows Integrated Auth with Kerberos.

Error at Data Flow Task [SharePoint List Source [1]]: System.ServiceModel.Security.MessageSecurityException: The HTTP request is unauthorized with client authentication scheme 'Ntlm'. The authentication header received from the server was 'Negotiate,NTLM'. ---> System.Net.WebException: The remote server returned an error: (401) Unauthorized.
at System.Net.HttpWebRequest.GetResponse()
at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
--- End of inner exception stack trace ---

Server stack trace:
at System.ServiceModel.Channels.HttpChannelUtilities.ValidateAuthentication(HttpWebRequest request, HttpWebResponse response, WebException responseException, HttpChannelFactory factory)
at System.ServiceModel.Channels.HttpChannelUtilities.ValidateRequestReplyResponse(HttpWebRequest request, HttpWebResponse response, HttpChannelFactory factory, WebException responseException, ChannelBinding channelBinding)
at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoap.GetListAndView(GetListAndViewRequest request)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.ListsService_ListsSoap_GetListAndView(GetListAndViewRequest request)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.GetListAndView(String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.GetSharePointList(String listName, String viewId)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.GetSharePointFields(String listName, String viewId)
at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.GetFields(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.GetAccessibleSharePointColumns(String sharepointUrl, String listName, String viewName)
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.ValidateSharePointColumns()
at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.Validate()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostValidate(IDTSManagedComponentWrapper100 wrapper)
Error at Data Flow Task [SSIS.Pipeline]: component "SharePoint List Source" (1) failed validation and returned error code 0x80131501.
↧
↧

New Post: How do I import Large Lists with SharePoint List Source adapter?

March 8, 2013, 3:03 pm
$
0
0
Thanks David,
How did you do it? can you step through the steps? Did you require a loop or use CAML query to set limits?
Could it be that you have no limit restrictions on your SharePoint list? is it 2010? and could you have god mode special permission to allow you to bypaas the 5000k limit? I can get it to work for list less then 5000K no problem.
↧

New Post: XML Destination

March 11, 2013, 6:53 am
$
0
0
The xmldest.dll works fine in sql server 2012, but I needed another encoding.
I've changed the encoding to unicode in 'xmldest.cs' in project xmlDest_SQL2012 and now I receive the following errors below:

Error: 0xC004801F at Data Flow Task, SSIS.Pipeline: The component metadata for "XML Destination, clsid {874F7595-FB5F-40FF-96AF-FBFF8250E3EF}" could not be upgraded to the newer version of the component. The PerformUpgrade method failed.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Error: 0xC0048021 at Data Flow Task, XML Destination [47]: The component is missing, not registered, not upgradeable, or missing required interfaces. The contact information for this component is "".
Error: 0xC0047017 at Data Flow Task, SSIS.Pipeline: XML Destination failed validation and returned error code 0xC0048021.
Error: 0xC004700C at Data Flow Task, SSIS.Pipeline: One or more component failed validation.
Error: 0xC0024107 at Data Flow Task: There were errors during task validation.

Does anyone know what to do?
↧
Search

New Post: SharePoint List Adapter on 2012

March 18, 2013, 6:27 pm
$
0
0
I had this adapter previously installed with VS 2008, and had issues making it work by simply Upgrading/Repairing the List Adapter. VS2010 would not even be able to upgrade the SSIS Package: The wizard would fail and the package would be unusable.

I had to completely remove the List Adapter from Add/Remove programs, and re-install it. Then I was able to run successfully the Upgrade Wizard on the SSIS Packages and work with them.

P.S. Love the adapter btw ;)
↧

New Post: Any way to import from multiple SharePoint sites in a loop?

March 21, 2013, 3:00 am
$
0
0
Hi,

I've got a number of SharePoint sites, all with the same list definition inside; I'd like to use SSIS to consolidate the data from all those sites;

Importing multiple sharepoint sites

I'm struggling to see if you can vary the 'SiteUrl' property of the SharePoint List Source inside the ForEach loop. I would normally expect to see an 'Expressions' property and do something like "SiteUrl : @User::sharepointUrl" but there doesn't seem to be anything like that.

Any ideas?
↧
↧

New Post: Enable Forms Based Authentication when using the SharePoint List Source with Integration Project

April 4, 2013, 8:28 am
$
0
0
The site I am trying to get the list data from is only setup for Form's Based Authentication and when I work with the List Control in a Visual Studio Integration Project I am getting the following:
The HTTP request was forbidden with client authentication scheme 'Ntlm'. ---> System.Net.WebException: The remote server returned an error: (403) Forbidden.

Is there a way to tell the ConnectionManager not to use NTLM and use Forms Based Authentication?

Any help is appreciated.
Steve
↧

Reviewed: EzAPI - Package Generation API (SQL 2012) (abr 04, 2013)

April 4, 2013, 9:38 am
$
0
0
Rated 4 Stars (out of 5) - i want learn to generate pakage, thaks
↧

Commented Issue: SharePoint List Adapters: Support SQL 2012 Release Version [19218]

April 8, 2013, 4:20 pm
$
0
0
Hi

We are migrating from 2008 R2 to 2012. We have made extensive use of the SharePoint List adapters to get data in an out of SharePoint lists with SSIS. Now with Data Tools I cannot get the components installed. With 2008 R2 there were tabs for Data Flow components when adding items to the toolbox. Gone in Data Tools. I have seen a few posts with people having the same problem. Has anyone got this working and if so share please. I believe the same .msi file can be used for 2012 as was used in 2008 R2. I have not attempted a reinstall as I dont want to mess up the existing 2008 packages until they get migrated.

Help!!!

Thanks
Trevor
Comments: ** Comment from web user: siraj098 **

I am having hard time using the Source List control in SSIS 2012 integration service.
Few things
No Expression Builder
No CAMLQuery . not working properly as you can only add one line.
No Field Selection
Not Working with Views.

Any help will be highly appreciated. I dont think its ready for SQL 2012

↧
Viewing all 582 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>