Download a file from REST API and upload to Sharepoint without need for intermediate storage

Question

My first post here, as I am newb to scripting/programming.

I have a requirement to download files from an external service via a REST API and then upload those files to SharePoint. I have put together a script that can do this, but it uses intermediate local storage, as the script uses two different functions to achieve this (download locally using Invoke-RestMethod and upload from local to SharePoint using Connect-PnPOnline and Add-PNPFile

What I would like to do, is achieve this without using local storage, as I would like to move this to a serverless Azure Function.

Below is my script. Any feedback on streamlining this to achieve the removal of local storage are appreciated.

Just a note, this is still a prototype, so I will also externalise all the credential information once I have the base functionality working.

# Script to connect to API and download recordings

# Define links to the  API
$download_endpoint = 'https://api.externalservice.com/download'

# Define the download file
$recording = 'C:\Users\UserName\filename.mp3'

# Define security credentials for connecting to the API
$api_key = 'pk_xxxxxxxxxxxxxxxxxxxxxxxxxxxxx'
$api_secret = 'sk_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx'

# Connect to the API
$auth = $api_key + ':' + $api_secret
$Encoded = [System.Text.Encoding]::UTF8.GetBytes($auth)
$authorizationInfo = [System.Convert]::ToBase64String($Encoded)
$headers = @{"Authorization"="Basic $($authorizationInfo)"}

Invoke-RestMethod -Uri $download_endpoint -OutFile $recording -Headers $headers

# Set variables for the SharePoint site and library
$tenant = "companyname.onmicrosoft.com"
$siteURL = "https://companyname.sharepoint.com/site"
$libraryName = "Test"

# Define credentials for connecting to SharePoint
$applicationID = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
$certpath = "C:\Users\UserName\companyname.pfx"
$password = "XXXXXXXXXXXXXX"

# Connect to SharePoint Online using modern authentication
Connect-PnPOnline -Url $siteURL -ClientId $applicationID -CertificatePath $certpath -CertificatePassword (ConvertTo-SecureString -AsPlainText $password -Force) -Tenant $tenant

# Upload the file to the library
Add-PnPFile -Path $recording -Folder $libraryName

# Disconnect from SharePoint Online
Disconnect-PnPOnline

Instead of writing to a file you can use a MemoryStream. – jdweng Mar 07 '23 at 04:18 — jdweng, Mar 07 '23 at 04:18

Santiago Squarzon · Accepted Answer · 2023-03-07T22:41:22.787

1

Add-PnpFile has a -Stream parameter which you can use instead of -Path. In that sense, you could change Invoke-RestMethod for Invoke-WebRequest and use the MemoryStream included in the .RawContentStream Property of the returned object. The code remains about the same and only requires these modifications:

$req = Invoke-WebRequest -Uri $download_endpoint -Headers $headers -UseBasicParsing

# Connect here, stays the same
# Then upload uses `-Stream`
# Also, in this ParameterSet `-FileName` is Mandatory

Add-PnPFile -Stream $req.RawContentStream -Folder $libraryName -FileName somefile.ext

edited Mar 07 '23 at 22:41

answered Mar 07 '23 at 04:53

Santiago Squarzon

41,465
5
14
37

Thanks @Santiago Squarzon, that worked, albeit it prompted me to input a file name. I'll work through defining that, so that I don't get a manual prompt in the future. – Micksta Mar 07 '23 at 05:31
Quick update, I added the -Filename parameter to the Add-PNPFile command and corrected the manual filename prompt. All good now. – Micksta Mar 07 '23 at 05:40

Download a file from REST API and upload to Sharepoint without need for intermediate storage

1 Answers1