黑松山资源网 Design By www.paidiu.com
本文实例讲述了python查找指定具有相同内容文件的方法。分享给大家供大家参考。具体如下:
python代码用于查找指定具有相同内容的文件,可以同时指定多个目录
调用方式:python doublesdetector.py c:\;d:\;e:\ > doubles.txt
# Hello, this script is written in Python - http://www.python.org # doublesdetector.py 1.0p import os, os.path, string, sys, sha message = """ doublesdetector.py 1.0p This script will search for files that are identical (whatever their name/date/time). Syntax : python %s <directories> where <directories> is a directory or a list of directories separated by a semicolon (;) Examples : python %s c:\windows python %s c:\;d:\;e:\ > doubles.txt python %s c:\program files > doubles.txt This script is public domain. Feel free to reuse and tweak it. The author of this script Sebastien SAUVAGE <sebsauvage at sebsauvage dot net> http://sebsauvage.net/python/ """ % ((sys.argv[0], )*4) def fileSHA ( filepath ) : """ Compute SHA (Secure Hash Algorythm) of a file. Input : filepath : full path and name of file (eg. 'c:\windows\emm386.exe') Output : string : contains the hexadecimal representation of the SHA of the file. returns '0' if file could not be read (file not found, no read rights...) """ try: file = open(filepath,'rb') digest = sha.new() data = file.read(65536) while len(data) != 0: digest.update(data) data = file.read(65536) file.close() except: return '0' else: return digest.hexdigest() def detectDoubles( directories ): fileslist = {} # Group all files by size (in the fileslist dictionnary) for directory in directories.split(';'): directory = os.path.abspath(directory) sys.stderr.write('Scanning directory '+directory+'...') os.path.walk(directory,callback,fileslist) sys.stderr.write('\n') sys.stderr.write('Comparing files...') # Remove keys (filesize) in the dictionnary which have only 1 file for (filesize,listoffiles) in fileslist.items(): if len(listoffiles) == 1: del fileslist[filesize] # Now compute SHA of files that have the same size, # and group files by SHA (in the filessha dictionnary) filessha = {} while len(fileslist)>0: (filesize,listoffiles) = fileslist.popitem() for filepath in listoffiles: sys.stderr.write('.') sha = fileSHA(filepath) if filessha.has_key(sha): filessha[sha].append(filepath) else: filessha[sha] = [filepath] if filessha.has_key('0'): del filessha['0'] # Remove keys (sha) in the dictionnary which have only 1 file for (sha,listoffiles) in filessha.items(): if len(listoffiles) == 1: del filessha[sha] sys.stderr.write('\n') return filessha def callback(fileslist,directory,files): sys.stderr.write('.') for fileName in files: filepath = os.path.join(directory,fileName) if os.path.isfile(filepath): filesize = os.stat(filepath)[6] if fileslist.has_key(filesize): fileslist[filesize].append(filepath) else: fileslist[filesize] = [filepath] if len(sys.argv)>1 : doubles = detectDoubles(" ".join(sys.argv[1:])) print 'The following files are identical:' print '\n'.join(["----\n%s" % '\n'.join(doubles[filesha]) for filesha in doubles.keys()]) print '----' else: print message
希望本文所述对大家的Python程序设计有所帮助。
黑松山资源网 Design By www.paidiu.com
广告合作:本站广告合作请联系QQ:858582 申请时备注:广告合作(否则不回)
免责声明:本站资源来自互联网收集,仅供用于学习和交流,请遵循相关法律法规,本站一切资源不代表本站立场,如有侵权、后门、不妥请联系本站删除!
免责声明:本站资源来自互联网收集,仅供用于学习和交流,请遵循相关法律法规,本站一切资源不代表本站立场,如有侵权、后门、不妥请联系本站删除!
黑松山资源网 Design By www.paidiu.com
暂无评论...
更新日志
2024年10月09日
2024年10月09日
- 谢金晶.2017-放心【豪记】【WAV+CUE】
- 炉石传说最强死亡骑士卡组是什么 死亡骑士最强天梯卡组推荐一览
- 炉石传说最强德鲁伊卡组是哪个 德鲁伊最强天梯卡组推荐一览
- 炉石传说最强战士卡组是哪个 战士最强天梯卡组推荐一览
- LexVandyke《HistoriadeunAmor情陷地中海》[WAV+CUE]
- TheBestPopClassics《LIGHTRHYTHMSOUND2》[WAV+CUE]
- TheLatinSoundofLexVandyke-ConciertodeAranjuez拉丁情人2012[SACD-ISO]
- 《怪物猎人世界》史低¥44,《耻辱终极版》仅需¥12
- 杉果秋促最后一天!海量3A大作击穿Steam史低
- 【果娘聊天室】国庆假期就这么水灵灵地结束啦!
- 《死或生》恋爱游戏新角色:来自大雷温柔公主的喂食
- 《寂静岭2》原制作人盛赞《寂静岭2:重制版》:新玩家能玩 我超高兴
- 艾什莉体模家今日份的COS:《鸣潮》守岸人 雪白香肩清纯而诱惑
- 微信积分商城进入方法,微信积分商城介绍
- 希诺宁进不进常驻说明,希诺宁角色分析