Kowa yana son Google Trends, amma yana da ɗan wayo idan ya zo ga Maƙallan Long Tail. Dukanmu muna son jami'in sabis na yanayin google don samun fahimta kan halayyar bincike. Koyaya, abubuwa biyu suna hana mutane da yawa amfani da shi don aiki mai ƙarfi;
- Lokacin da kake buƙatar nemo sabon kalmomin alkuki, akwai bai isa ba bayanai kan Google Trends
- Rashin API na hukuma don yin buƙatu don abubuwan google: Lokacin da muke amfani da kayayyaki kamar syeda, to dole ne muyi amfani da sabobin wakili, ko kuma an katange mu.
A cikin wannan labarin, Zan raba rubutun Python da muka rubuta don fitarwa kalmomin kewaya ta hanyar Google Autosuggest.
Etauko da Adana Sakamakon Sakamakon osarshe akan Lokaci
A ce muna da keywords na 1,000 da za a aika zuwa Google Autosuggest. A dawo, tabbas zamu sami kusan 200,000 dogon lokaci keywords. Bayan haka, muna buƙatar yin hakan mako ɗaya daga baya kuma mu kwatanta waɗannan bayanan don amsa tambayoyin biyu:
- Wadanne tambayoyi ne sababbin kalmomi idan aka kwatanta da na ƙarshe? Wannan tabbas wannan shine lamarin da muke bukata. Google yana tsammanin waɗannan tambayoyin suna da mahimmanci - ta yin hakan, zamu iya ƙirƙirar namu Google Autosuggest bayani!
- Wadanne tambayoyi ne keywords ba yayi?
Rubutun yana da sauƙi, kuma mafi yawan lambobin da na raba nan. Lambar da aka sabunta tana adana bayanan daga abubuwan da suka gabata da kuma kwatanta shawarwarin akan lokaci. Mun guji bayanan tushen fayil kamar SQLite don sauƙaƙa shi - don haka duk ajiyar bayanan suna amfani da fayilolin CSV da ke ƙasa. Wannan yana ba ku damar shigo da fayil ɗin a cikin Excel kuma bincika ginshiƙan maɓallin keɓaɓɓu don kasuwancinku.
Don Amfani da Wannan Rubutun Python
- Shigar da saitin maɓallin keɓaɓɓiyar iri da yakamata a aika zuwa ga autocomplete: keywords.csv
- Daidaita saitunan rubutun don buƙatarku:
- LANGUAGE: tsoho “en”
- KASA: tsoho "mu"
- Jadawalin rubutun don gudana sau ɗaya a mako. Hakanan zaka iya gudanar dashi da hannu kamar yadda kake so.
- Yi amfani da keyword_suggestions.csv don ƙarin bincike:
- fara_ ganga: wannan ita ce ranar da tambayar ta bayyana a karon farko a cikin autosuggest
- last_seen: ranar da aka ga tambayar a karo na karshe
- sabon_: idan first_seen == last_seen mun saita wannan zuwa Gaskiya - Just tace a kan wannan darajar don samun sabon yayi Trending bincike a cikin Google autosuggest.
Ga Lambar Python
# Pemavor.com Autocomplete Trends
# Author: Stefan Neefischer (stefan.neefischer@gmail.com)
import concurrent.futures
from datetime import date
from datetime import datetime
import pandas as pd
import itertools
import requests
import string
import json
import time
charList = " " + string.ascii_lowercase + string.digits
def makeGoogleRequest(query):
# If you make requests too quickly, you may be blocked by google
time.sleep(WAIT_TIME)
URL="http://suggestqueries.google.com/complete/search"
PARAMS = {"client":"opera",
"hl":LANGUAGE,
"q":query,
"gl":COUNTRY}
response = requests.get(URL, params=PARAMS)
if response.status_code == 200:
try:
suggestedSearches = json.loads(response.content.decode('utf-8'))[1]
except:
suggestedSearches = json.loads(response.content.decode('latin-1'))[1]
return suggestedSearches
else:
return "ERR"
def getGoogleSuggests(keyword):
# err_count1 = 0
queryList = [keyword + " " + char for char in charList]
suggestions = []
for query in queryList:
suggestion = makeGoogleRequest(query)
if suggestion != 'ERR':
suggestions.append(suggestion)
# Remove empty suggestions
suggestions = set(itertools.chain(*suggestions))
if "" in suggestions:
suggestions.remove("")
return suggestions
def autocomplete(csv_fileName):
dateTimeObj = datetime.now().date()
#read your csv file that contain keywords that you want to send to google autocomplete
df = pd.read_csv(csv_fileName)
keywords = df.iloc[:,0].tolist()
resultList = []
with concurrent.futures.ThreadPoolExecutor(max_workers=MAX_WORKERS) as executor:
futuresGoogle = {executor.submit(getGoogleSuggests, keyword): keyword for keyword in keywords}
for future in concurrent.futures.as_completed(futuresGoogle):
key = futuresGoogle[future]
for suggestion in future.result():
resultList.append([key, suggestion])
# Convert the results to a dataframe
suggestion_new = pd.DataFrame(resultList, columns=['Keyword','Suggestion'])
del resultList
#if we have old results read them
try:
suggestion_df=pd.read_csv("keyword_suggestions.csv")
except:
suggestion_df=pd.DataFrame(columns=['first_seen','last_seen','Keyword','Suggestion'])
suggestionCommon_list=[]
suggestionNew_list=[]
for keyword in suggestion_new["Keyword"].unique():
new_df=suggestion_new[suggestion_new["Keyword"]==keyword]
old_df=suggestion_df[suggestion_df["Keyword"]==keyword]
newSuggestion=set(new_df["Suggestion"].to_list())
oldSuggestion=set(old_df["Suggestion"].to_list())
commonSuggestion=list(newSuggestion & oldSuggestion)
new_Suggestion=list(newSuggestion - oldSuggestion)
for suggest in commonSuggestion:
suggestionCommon_list.append([dateTimeObj,keyword,suggest])
for suggest in new_Suggestion:
suggestionNew_list.append([dateTimeObj,dateTimeObj,keyword,suggest])
#new keywords
newSuggestion_df = pd.DataFrame(suggestionNew_list, columns=['first_seen','last_seen','Keyword','Suggestion'])
#shared keywords with date update
commonSuggestion_df = pd.DataFrame(suggestionCommon_list, columns=['last_seen','Keyword','Suggestion'])
merge=pd.merge(suggestion_df, commonSuggestion_df, left_on=["Suggestion"], right_on=["Suggestion"], how='left')
merge = merge.rename(columns={'last_seen_y': 'last_seen',"Keyword_x":"Keyword"})
merge["last_seen"].fillna(merge["last_seen_x"], inplace=True)
del merge["last_seen_x"]
del merge["Keyword_y"]
#merge old results with new results
frames = [merge, newSuggestion_df]
keywords_df = pd.concat(frames, ignore_index=True, sort=False)
# Save dataframe as a CSV file
keywords_df['first_seen'] = pd.to_datetime(keywords_df['first_seen'])
keywords_df = keywords_df.sort_values(by=['first_seen','Keyword'], ascending=[False,False])
keywords_df['first_seen']= pd.to_datetime(keywords_df['first_seen'])
keywords_df['last_seen']= pd.to_datetime(keywords_df['last_seen'])
keywords_df['is_new'] = (keywords_df['first_seen']== keywords_df['last_seen'])
keywords_df=keywords_df[['first_seen','last_seen','Keyword','Suggestion','is_new']]
keywords_df.to_csv('keyword_suggestions.csv', index=False)
# If you use more than 50 seed keywords you should slow down your requests - otherwise google is blocking the script
# If you have thousands of seed keywords use e.g. WAIT_TIME = 1 and MAX_WORKERS = 5
WAIT_TIME = 0.2
MAX_WORKERS = 20
# set the autocomplete language
LANGUAGE = "en"
# set the autocomplete country code - DE, US, TR, GR, etc..
COUNTRY="US"
# Keyword_seed csv file name. One column csv file.
#csv_fileName="keyword_seeds.csv"
CSV_FILE_NAME="keywords.csv"
autocomplete(CSV_FILE_NAME)
#The result will save in keyword_suggestions.csv csv file
