Box.com - How to use a service account to crawl all enterprise users' box files

Question

I am using Box.com Java SDK.

I'd like to loop through the users in my Box.com enterprise and crawl the documents in each persons account.

I have set Authentication type set up for OAuth2.0 with JWT. I have enabled the "As-User" header. and I have updated "User Access" to "All Users" so that I can see all users files whether they are through the https://box.com website or if they are completely on the backend.

If I request all the files in /0 as this user, will it return me all the files for all users on the system?

How can I start crawling through each users file?

I think the answer to this is you need to Loop through users using box_client.users() and then you crawl as each user one by one using those user's and the "As-User" header. — Nicholas DiPiazza, Feb 01 '17 at 14:36
but that still brings up the question - how can you make it so the enterprise api can access all different types of users' content? Otherwise it will return this error http://stackoverflow.com/questions/33683246/box-api-token-request-enterprise-configuration-issue — Nicholas DiPiazza, Feb 01 '17 at 16:08

score 1 · Accepted Answer · answered Feb 01 '17 at 18:16

I tried this and it seems to work...

public static void main(String[] args) throws IOException {
{
        String privateKey = new String(Files.readAllBytes(Paths.get(PRIVATE_KEY_FILE)));

        JWTEncryptionPreferences encryptionPref = new JWTEncryptionPreferences();
        encryptionPref.setPublicKeyID(PUBLIC_KEY_ID);
        encryptionPref.setPrivateKey(privateKey);
        encryptionPref.setPrivateKeyPassword(PRIVATE_KEY_PASSWORD);
        encryptionPref.setEncryptionAlgorithm(EncryptionAlgorithm.RSA_SHA_256);

        IAccessTokenCache accessTokenCache = new InMemoryLRUAccessTokenCache(MAX_CACHE_ENTRIES);

        BoxDeveloperEditionAPIConnection api = BoxDeveloperEditionAPIConnection.getAppEnterpriseConnection(ENTERPRISE_ID, CLIENT_ID, CLIENT_SECRET, encryptionPref, accessTokenCache);

        Iterable<com.box.sdk.BoxUser.Info> users = BoxUser.getAllEnterpriseUsers(api, "App");
        for (BoxUser.Info user : users) {

            BoxDeveloperEditionAPIConnection userApi = BoxDeveloperEditionAPIConnection.getAppUserConnection(user.getID(), CLIENT_ID, CLIENT_SECRET, encryptionPref, accessTokenCache);
            System.out.println(new BoxUser(userApi, user.getID()).getInfo().getName());

            BoxFolder boxFolder = BoxFolder.getRootFolder(userApi);
            Iterable<com.box.sdk.BoxItem.Info> items = boxFolder.getChildren();
            for (BoxItem.Info item : items) {
                System.out.println("\t" + item.getName());
            }
        }
}

any idea how long it will take for an enterprise account with `BoxUser.getAllEnterpriseUsers(api, "App");` 10,000+ users? — Nicholas DiPiazza, Feb 01 '17 at 19:49
Sorry! I'm not sure but there's also rate-limits too on how many calls you can make during a certain time period. — kendomen, Feb 01 '17 at 19:59
This is very interesting that you did not have to use `As-User` header. — Nicholas DiPiazza, Mar 28 '17 at 20:43

Box.com - How to use a service account to crawl all enterprise users' box files

1 Answers1