def _nodup_filter(self, min_hash, all_urls, max_sample=<NUM_LIT:200>):
if not all_urls:<EOL><INDENT>return <NUM_LIT:0><EOL><DEDENT>urls = random.sample(all_urls, max_sample)if len(all_urls) > max_sample else all_urls<EOL>filtered = [<EOL>url for url in urls<EOL>if min_hash.jaccard(self.seen_urls[url].min_hash) <<EOL>self.jaccard_threshold]<EOL>return int(len(filtered) / len(urls) * len(all_urls))<EOL>
This filters results that are considered not duplicates.
        But we really need to check that, because lsh.query does not always
        return ALL duplicates, esp. when there are a lot of them, so
        here we double-check and return only urls that are NOT duplicates.
        Return estimated number of not duplicates.