We heard you want to do a professional networks search. Awesome, that's what we're here for n this article, we'll walk you through several ways to search professional networks, including both user interfaces and APIs. We'll also provide some code samples in case you're interested in checking out a third-party API solution called Enrich Layer which provides a developer-friendly interface for searching professional networks.
First, let's talk about some UI tools that can help you search the platform. These range from free to paid, and the quality of the results you get will vary with price.
You can use Google to search the platform with the site keyword. For example, we could search for the company Apple by typing site:professionalsocialnetwork.com apple into Google. If you have any terms that you expect to appear on the the platform page of the target you're seeking, you can add them, freeform, to your Google search.
This behavior might be convenient if you're seeking a single page and know its name already, but it's generally not gonna work out so well - try searching site:professionalsocialnetwork.com/company cupertino and getting the City of Cupertino and Cupetino Union School District, nothing to do with Apple - there's no way to provide structured data here, which is what we need to do.
Using the platform search through its built-in search bar is also free. For example, if you want to search for the company Apple, you type "Apple," and then you will probably get the company Apple. You can then click the Apple feature screen, and the next thing you know, you're on Apple's professional networks profile.
Say, though, that you wanted to look for a technology company located in the United States. Then you could instead use the filters along the top of the page. They look like this:
Here's how they look once you've selected some of them:
But what if this isn't enough granularity?
The mecca of boolean search. It's a paid product, but if you only need it for one month, you can cash in on your once-in-a-lifetime free trial, and it's a pretty excellent tool at that price.
You get access to nearly unlimited ("nearly" is necessary, it's not truly unlimited) Boolean logic on a large number of fields, and you can also save the lists you've made for future access. For more information on the the platform Sales Navigator, do check out our the platform Sales Navigator deep dive.
UpLead is the only unofficial UI option in our list, and it's here because it's just that good (but keep in mind how much you'll be spending on it). Its UI contains a lot of the fields you're used to in Sales Navigator, like "technologies used," but UpLead enriches with data from sources other than the platform.
The catch? UpLead is expensive; in addition to a monthly fee, you have to pay a credit cost per individual profile that you unlock, and each profile costs as much as $0.60 on their low-commitment plan or $0.30 on their high-commitment plan. Go there for the GUI, but don't stay for volume, and certainly don't stay for their API.
Now, we'll talk about a couple tools aimed at developers. We'll first compare and contrast two competing products for Search, Enrich Layer and People Data Labs, and we'll show you why we think Enrich Layer is the better option. And just for fun, we'll show off a couple of other features that Enrich Layer has.
Let's get right into it
Before we look at the code, let's discuss the costs. PDL gives you a few free credits, but after that, this request normally costs you $0.23 - $0.16 cents per result. Assuming you're making queries at scale (think 200+ results per search), Enrich Layer's flat fee ($0.70 - $0.32, depending on your plan) will be fully amortized across your result set and effectively disappear. At that point, you're paying somewhere between $0.20 and $0.09 per result, depending on volume, and even less than that if you're on an enterprise plan.
To summarize:
PDL has no fee per query, but each result costs more.
Enrich Layer has a fee per query, but each result costs less.
When you query a lot of results, the fee per query is amortized into the Price Per Result, and so overall Enrich Layer is charging you a lot less.
Even more TL;DR: Enrich Layer costs less than PDL. Always do the full math for yourself when you see sites with different credit arithmetic.
In this case study, your company needs to fill developer positions with candidates who are alumni of some specific company or set of companies (in this case, we're using Discord as our example company).
We'll omit the results in both cases; we want to avoid committing people's PII to a blog post. Enrich Layer is set to give you a JSON, which you could easily continue processing if you dropped out json.dumps. PDL will generate a CSV.
First, we'll look at the Enrich Layer solution, where about half the file is imports and defining constants:
import json, os, requests api_ = requests.get(api_endpoint, print(json.dumps(response.json())) # json.dumps is only for formatting
Note the (?i) flag to make our regular expression case-insensitive.
Now we'll take a look at the People Data Labs solution. Here's how you do it using their Elasticsearch-based approach. The advantage of Elasticsearch is more control over each query. The disadvantage is, well, queries that look like this (and note that we're still missing out on job titles like "staff software engineer" etc.).
`# This code was generated by People Data Labs's Query Builder import os, requests, JSON, time, csv
API_
MAX_NUM_ # a small number here since we don't have unlimited API access there
PDL_ request_ = { "query": { "bool": { "must": [ { "term": { "job_company_the platform_url": "professionalsocialnetwork.com/company/discord" } }, { "terms": { "job_title": [ "software engineer", "senior software engineer", "swe" ] } } ] } } }
num_records_to_ "dataset": "all", "query": json.dumps(ES_QUERY), "size": num_records_to_request, "pretty": True }
all_ start_ while 1 or params["scroll_token"]: if MAX_NUM_RECORDS != -1:
num_records_to_ - len(all_records)
num_records_to_ min(num_records_to_request, 100))
if num_records_to_ 0: break
params["size"] = num_records_to_request
I'd rather stick to myparams` dict, but you're welcome to give it a try.
In the final section, we'll look at a couple of interesting examples with Search using Enrich Layer. If you want more, you can find a whole bunch more in our Enrich Layer Search blog announcement.
This was the toy example I used in our the platform Sales Navigator article, but in that article, I never provided code. Let's fix this immediately pecifically, we'll search for:
Stripe SWEs
With 6 years of experience at Stripe
Who aren't in the Bay Area (here, we'll use San Francisco)
And here's the code:
import json, os, requests api_ 'city': '^(?!.*San Francisco)', 'current_company_the platform_profile_url': 'https://www.professionalsocialnetwork.com/company/stripe/', 'current_role_before': '2018-01-01', \} print(json.dumps(response.json())) # json.dumps is only for formatting
Don't recognize the regex syntax in the city field? That's called "negative lookahead," and it means that the city field cannot contain "San Francisco." Even if you don't recognize lookaround, you might be familiar with \b, another so-called "zero-width assertion." Zero-width assertions state (or "assert") a condition that must be true about the regex at this point without actually consuming any characters (so their "width" is "zero"). They're super useful nyway, since this query returns people, we won't print the results here; you know the drill. But feel free to run it on your own - or modify it to your heart's content.
Here's another one you can personalize and do at home. Find alumni of your school with your same major working at top companies - maybe this can help you get an introduction somewhere.
Here's the base code:
import json, os, requests api_ 'education_school_name': 'Caltech', 'education_field_of_study': 'Mathematics', \} print(json.dumps(response.json())) # json.dumps is only for formatting
Parameters you can add to this include:
current_company_name or past_company_name with a list of companies you're interested in separated by | and with ^()\\ wrapping the expression. For example, ^(Amazon|Apple)\\.
Alternatively, if you're only interested in one company, use the current_company_the platform_profile_url or past_company_the platform_profile_url field.
Once again, since this query returns a list of names, we won't show the example output.
Last time, I said there was no silver bullet if you wanted a company API. And the same thing is true if you want something as general as to "search the platform." Boolean search? the platform Sales Navigator - or maybe UpLead - or perhaps you know of a better tool. But if you want to search the platform as a developer, you want to go with Enrich Layer. Ever since our Search API launched, we've been hard at work making it a best-in-class experience for developers to automate their way through thousands of results. So why wait? Sign up for an account and claim your free credits now
