python - Searching bing results with a script results in an encoding issue -

-

i've written following in order number of search results per word in wordlist:

with open ("c:\wordslist.txt") f:     lines = f.readlines()  def bingsearch(word):        r = requests.get('http://www.bing.com/search',                  params={'q':'"'+word+'"'}                 )     soup = beautifulsoup(r.text, "html.parser")     return (soup.find('span',{'class':'sb_count'}))  matches = [re.search(regex,line).groups() line in lines] match in matches:            searchword = match[0]     found = bingsearch(searchword)     print (found.text)

it works , accurate results, except words containing special characters, example word: "número".

if call bingsearch("número") accurate result. if call bingsearch(match[0]) (where printing match[0] yields "número") inaccurate result.

i've tried stuff str(match[0]), match[0].encode(encoding="utf-8"), no success.

any ideas?

try giving encoding directly when open file, can make difference

with open ("c:\wordslist.txt", encoding="utf-8") f:

https://docs.python.org/3/library/functions.html#open


Comments

Post a Comment

Popular posts from this blog

sequelize.js - Sequelize group by with association includes id -

-
so when requesting group sequelize follows: return models.workingcalendar .findall({ attributes: [ 'workingcalendar.periodid', 'workingcalendar.date', 'period.name' ], include: [ { model: models.period, attributes: [] } ], where: { getsudoid: currentgetsudo.id, unitplantid: unitplantid }, group: ['workingcalendar.periodid', 'workingcalendar.date', 'period.name'], }); sequelize run query: select [workingcalendar].[id], [workingcalendar].[periodid], [workingcalendar].[date], [period].[name] [workingcalendars] [workingcalendar] left outer join [periods] [period] on [wor...
Read more

delphi - Take screenshot in webcam using VFrames in Console Application -

-
i'm doing program take picture of webcam using delphi xe2 , vframes achieve this, problem have figured out, in graphic application works fine, when use unit in console application, returns me error saying first chance exception @ $76b6b727. exception class eaccessviolation message 'access violation @ address 004a271b in module 'console.exe'. read of address 00000260'. process console.exe (3676) my unit : unit webcam; interface uses sysutils, windows, vcl.imaging.jpeg, vcl.graphics, vsample, vframes, classes; type twebcam = class private procedure newvideoframeevent(sender: tobject; width, height: integer; dataptr: pointer); public constructor create; destructor destroy; override; procedure capture_webcam(take_name: string); end; var web_image: tvideoimage; name_screen: string; implementation constructor twebcam.create; begin inherited create; end; destructor twebcam.destroy; begin inherited destroy; end; ...
Read more

ubuntu - Executors lost when starting pyspark in YARN client mode -

-
i able run pyspark in yarn client mode in laptop , trying setup in laptop. however, time can't running. when try start pyspark in yarn client mode, gives me following error. using dynamic resource allocation, have set spark_executor_memory less yarn container memory. using hadoop 2.6.4, spark 1.6.1, ubuntu 15.10 is possible error due network issues? 16/06/12 01:49:34 info scheduler.dagscheduler: executor lost: 1 (epoch 0) in [1]: 16/06/12 01:49:34 info cluster.yarnclientschedulerbackend: disabling executor 1. 16/06/12 01:49:34 info storage.blockmanagermasterendpoint: trying remove executor 1 blockmanagermaster. 16/06/12 01:49:34 info storage.blockmanagermasterendpoint: removing block manager blockmanagerid(1, 192.168.2.16, 37900) 16/06/12 01:49:34 error client.transportclient: failed send rpc 9123554941984942265 192.168.2.16/192.168.2.16:47630: java.nio.channels.closedchannelexception java.nio.channels.closedchannelexception 16/06/12 01:49:34 info storage.blockmanagermast...
Read more