Navigation X
ALERT
Click here to register with a few steps and explore all our cool stuff we have to offer!



   408

need help with dupes

by Aquilla - 30 March, 2022 - 07:54 PM
This post is by a banned member (Aquilla) - Unhide
This post is by a banned member (CDSG) - Unhide
CDSG  
Registered
6.442
Posts
1.042
Threads
4 Years of service
#2
Use a combo editor
[Image: pepesadheart.png] [Image: pepejail.gif]
This post is by a banned member (Aquilla) - Unhide
This post is by a banned member (shady) - Unhide
shady  
Heaven
3.485
Posts
1.497
Threads
5 Years of service
#4
use emeditor.
 
[Image: Final_1.gif]
19k+ Sales - 5+ Years - LifeTime Warranty |List of  Products: https://rentry.co/1s1dstore
This post is by a banned member (UberFuck) - Unhide
UberFuck  
Godlike
1.555
Posts
375
Threads
5 Years of service
#5
(30 March, 2022 - 07:54 PM)Smartest Wrote: Show More
Like i dont know how to explain but :
I have combo
10k lines
i have 3k dupes
so i want to remove dupes AND i also want to remove accounts that were dupe yk
so i will remove 6k accs
and have my 4k from that combo
What should i do 
Ill rep person who help ty

if you want to use python...
 
Code:
import collections
 
def remove_duplicates(inputPath:str, outputPath:str):
    values = collections.Counter(open(inputPath,'r').readlines())
    with open(outputPath, 'w') as f:
        f.writelines([k for k,v in values.items() if v == 1])
       
infile = 'yourFile.txt'
outfile = 'dedupedFile.txt'
remove_duplicates(infile, outfile)

Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
or
Sign in
Already have an account? Sign in here.


Forum Jump:


Users browsing this thread: 1 Guest(s)