Data Mining Jobs

Hi, can you do a data crawl for sensitive vocabulary phrases? We need some sensitive words - such as words related to politics, war, military, violence, crime, pornography and so on. Purpose: for database cleansing We made this dirty thesaurus precisely to take care of dropping these bad words in the normal content, so a dirty thesaurus is needed We need the following national languages Russian French Portugal Project Details: 1: Need to crawl sensitive vocabulary words locally Or can you provide the appropriate dataset of sensitive words

I am in need of a skilled Machine Learning Developer who can help me build a causal model. I have a specific dataset that I would like to use for building the model. This dataset is of moderate complexity, featuring multiple variables. The primary goal of the model will be to understand the relationships between these variables. Key Responsibilities: - Utilize the provided dataset to develop a causal model - Ensure that the model is capable of effectively illustrating relationships between variables - Optimize the model for performance Ideal Candidate: - Proficient in Machine Learning and Python - Experience with building causal models - must have worked on techniques like robust synthetic control, dowhy, econml, trigamite, DECI and other double ML/causal techniques - Strong analytica...

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promotions or deals. • Move s...

Title: Automated Data Retrieval from Websites Using CRM and CID Numbers Description: We are looking for an experienced developer to automate the process of retrieving data from specific websites using CRM and CID numbers. The goal is to develop a script or tool that will: Look up Doctor's Specialization: Use CRM numbers to search on the website: CFM Doctors Search Extract doctor's information including their specialization. Look up Disease Descriptions: Use CID numbers to search on the website: MedicinaNet CID10 Search Extract the disease description. Deliverables: ( ) A script or tool that can take a list of CRM and CID numbers as input. Automate the search process on the specified websites. Extract the required data and compile it into an Excel file with separate sheets...

Please Sign Up or Login to see details.

Active Directory Expert to create a Python script and test data to capture all meta data linked to and which describes the confined parameters of an AD account, AD RMS (Rights management Services) group policy GPO etc. and export to a MS Excel File. More information attached.

I'm searching for an expert who can assist me in generating high-quality leads and databases. The candidate should be an expert in scrapping and generating leads, as per the requirement. We are open to buying the lead list and paying for the consultation. Please apply only if you know how to generate and scrape leads in bulk and are an expert or have rich experience in it. We are looking for experts only. Budget is not a constraint for the right candidate. To ensure you have read the description, start your application with the word "Blue" to be considered. Thank you.

I'm searching for an experienced Python developer to handle data collection and processing in the financial sector. Your tasks will consist of two core elements: - Data Collection: Obtaining data from diverse financial sources, including stock market data, cryptocurrency data, and financial news data. - Data Processing: Once collected, you'll perform various calculations and analyses, including statistical analysis, trend analysis, and calculations with a focus on historical data. Familiarity with these tasks and the financial sector is crucial to delivering the results needed. Your expertise in Python and financial data processing will contribute significantly to the project's success.

Want to extract a list of profiles including name, country, city, email, phone numbers, link to profile for a list of followers for total output should be around 100K profiles that will be used to feed meta audience (customer list)

As a dynamic and data-driven company, we're seeking an expert in excel and dashboard creation, who can turn our user preference data into an insightful pie chart dashboard. Key tasks will include: - Analyzing and working with key metrics like product preferences, and communication preferences. - Use this dataset to design and implement an easy-to-navigate dashboard. - Display product preferences using a pie chart. Ideal candidate will: - Have solid experience in Excel and creating data visualizations - Have a precise eye for detail to ensure accurate data interpretation - Have strong communication skills to understand and implement our specific preferences. We look forward to seeing how you can transform our data into valuable insights.

I'm seeking a talented data scientist specializing in ship engine assembly to analyze key parameters and offer process insights. Key Parameters and Metrics: - **Efficiency:** Analyze the efficiency of our ship engine assembly processes. - **Performance:** Look into the performance metrics of the assembly line. - **Reliability**: Assess the reliability of our ship engine assembly. Process Insights: - **Workflow Optimization:** Provide insights and recommendations on how we can optimize our workflow for better efficiency and productivity. - Collect datasets for llmRAG and embedding vector database - You should choose the models for llms and RAG and frameworks Ideal Skills: - Proven experience in data science, particularly in the manufacturing industry with a focus on ship engine as...

I'm in need of an expert in Rapid Miner to assist in analyzing a dataset and generating an inference report. Key Responsibilities: - Perform advanced data analysis on provided dataset. - Create and execute predictive models. - Generate a comprehensive inference report based on the analysis and model results. (2500 words) I would like to pay $50 for this project

I am looking for a freelancer to help me in drawing the developed Artificial Neural Network (ANN) which will predict data related to education. The visual representation of the selected parameters and the predicted data versus the actual data will be shown in the form of spreadsheets. Your role will be to: - Draw the developed ANN for education prediction - Show the selected parameters for the developed ANN - Visualize the predicted data versus the actual data in spreadsheets Ideal skills and experience: - Solid understanding of Artificial Neural Networks (ANN) - Experience in data visualization, particularly using spreadsheets - Familiarity with educational data or at least a background in developing predictive models in a related field - Ability to clearly communicate complex technica...

I'm in need of a talented professional who can help me with a custom web crawler project. Key Requirements: - **Web Crawler Customization:** The ideal candidate will need to adapt an existing web crawler code to include specific features I require. This includes the ability to extract and filter data from multiple websites. - **Data Management:** I expect the total scale of the data to be relatively small, so the freelancer should have experience handling data sets of this size. - **Data Analysis:** After the information is extracted, I intend to use it primarily for data analysis. The freelancer should have a good understanding of how to structure data for this purpose. Ideal Skills & Experience: - Proven experience in customizing web crawlers and managing data. - Proficient i...

I need a script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js e...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

I'm in need of a Machine Learning professional who is well-versed in applying SHAP (SHapley Additive exPlanations). Primary Responsibilities: - As the heart of this project involves building Machine Learning models, your role would be crucial in shaping the final product. - I am particularly interested in leveraging the Random Forest Algorithm that would be applied to structured data, encompassing numbers and categories. Essential Skills: - Proficiency in the ML Algorithm - Sound understanding of structured data - Proven experience with SHAP Your expertise will indeed be paramount to this project. As we plunge deeper into the data, your insights and guidance will undeniably lead us towards success.

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

I am seeking a skilled data miner to initially extract at least 1,000 company names, telephone numbers, and emails of translation agencies in the United States. We will provide the names of the cities, and the data miner will be responsible for searching local translation agencies on Google that meet these requirements. The database is to be created on a Google Spreadsheet. Based on this information, please tell us how many entries you can complete per hour and your best rate per hour.

### Project Name: Optimize Scrap Metal Supply Chain ### Project Description: I am from Turkey and need a top-notch scrap metal consultant to streamline our supply chain. The consultant will work online as a freelancer and focus on: - **Metal Sourcing**: Finding reliable suppliers, getting total prices, and negotiating deals. - **Logistics**: Finding transportation solutions and ensuring CIF delivery to Turkey. Ideal skills include in-depth knowledge of the scrap metal industry, excellent logistics management, superior negotiation abilities, and strong communication skills. --- Feel free to use this refined version in your freelancer project description.

I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.

I require a professional data entry freelancer to help me with a PDF data extraction task. The project involves extracting and organizing information from a series of PDF files. The data to be extracted varies and includes both text data and numerical data, in addition to images or diagrams. The ideal freelancer for this project should be experienced in data entry and be comfortable working with PDF files. Key requirements for the project include: - Extracting text and numerical data from PDF files - Organizing the extracted data in an easily accessible format - Ensuring accurate extraction of information - Handling images or diagrams within the PDF files The extracted information will be used for further analysis and will significantly contribute to a larger project. Accuracy, speed, a...

I am looking for a researcher to conduct a bibliometric analysis using VOSviewer for a project we have been working on for a while. The project falls within the category of social sciences. We have already gathered the data from WOS and Scopus. What I want is the visualization of this data along with explanations. (Small research database, around 120 articles) Key Responsibilities: - Conducting bibliometric analysis on a specific scientific articles dataset - Identifying and analyzing keyword occurrences within the dataset - Producing a comprehensive report on the keyword trends Ideal Skills: - Proficiency in VosViewer and other bibliometric analysis software - Experience in analyzing and interpreting scientific articles - Strong knowledge of bibliometric analysis methodologies - Abilit...

I’m seeking a data science expert, who specializes in machine learning, specifically with predictive analytics. The main goal of this project is to build a robust predictive model that can handle a yet-to-be-determined type of data. However, rest assured we have labeled data ready for model training. The perfect candidate would, therefore, have a strong background in: - Data science and predictive modeling - Machine learning application - Handling different sets of data, structured or unstructured. If you possess these skills and are able to rise to the challenge, kindly submit your proposal. I look forward to crafting a smarter future with your help!

I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.

As the client, I’m engaging this project for an in-depth investigation purpose. I have numerous photographs capturing crimes and betrayals, some of which have been under or over exposed on purpose. My key requirement hinges on using comprehensive digital image processing techniques to extract hidden information from these photos. The ideal freelancer for this task would have a strong background in this field, with proven expertise and enhanced skills. Expectations from the investigation include: • High level of detail: I need precise features clearly identified, even clear text if possible. The ultimate goal is to achieve the best possible clarity on the obscured parts of these crucial images. Therefore, this job best suits individuals who are proficient in digital forensic...

I've compiled a comprehensive global leads database with 8 million entries. The database includes a variety of details such as name, email, contact number, website, profession, and even Instagram username. - **Purpose**: This database is specifically designed for sales leads generation. It's meant to help businesses and organizations reach out to potential customers and grow their sales. - **Categorization**: The leads are not just categorized by one specific filter. Instead, they're a mix of different categories from various industries, countries, and professions. This eclectic mix provides a wide range of opportunities for potential buyers. - **Delivery Method**: I'm looking to sell this database through a CSV file, online access to the database, and a Google Driv...

I need an experienced Python developer for data analysis. Your primary role will involve: - Sorting and arranging small datasets (less than 1GB) - Applying your skills primarily to mixed data, including both numerical and textual elements The ideal candidate would possess a strong background in Python along with a solid understanding of data analysis. You must be highly efficient in reading, sorting and managing mixed datasets. Experience working on a similar project or scope would be a significant plus. Providing data analysis insights is also a bonus.

I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you're up for the task. I ...

I am currently using R, specifically the ppcor package, to conduct partial correlations on a sizable dataset. Unfortunately, the process is slow and fails to address all columns efficiently. I'm seeking assistance to: - Improve the computation speed - Enhance the handling of columns within my dataset The ideal freelancer for this task should be proficient in R programming, with specific experience in working with the ppcor package or similar tools for statistical analysis. A background in optimizing code for large datasets would be highly beneficial.

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+ Authentication is done through twi...

I require a one-time data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - Proficiency in web scraping, especially fro...

I need an expert in Optical Character Recognition (OCR) technology to convert text from high-resolution, clear photographs to editable text. Key Project Details: - **Purpose**: The primary objective of this task is to extract data from various documents. - **Image Type**: The text extraction will specifically be from photographs of text. - **Image Quality**: All photographs are high resolution and clear. Ideal Skills and Experience: - Proficient in Optical Character Recognition (OCR) technology - Prior experience in extracting data from images - Excellent attention to detail to ensure accurate transcription - Ability to work efficiently with high-resolution images

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I would like to see an example of 1 page done before...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or automation is a plus.

Start your offer with the word in the attachment, otherwise we dropp you out. We are looking for a database with websites, HAVING EMBEDDED YOUTUBE Videos on their sites. Prepare a list with : Name of the company, youtube Channel, Link to the first youtube video you find on the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we have a longterm Partnership. To decide who is our partner and to see your un...

I urgently need someone to extract shareholder information from the Madagascar business registry. The work needs to be done as soon as possible. Key Requirements: - Retrieve shareholder data from the Madagascar business registry - The data should be presented in a clear, easily understandable format

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I'm looking for a Python expert to help me create a new Python script for data analysis purposes. The primary goal of the script will be to analyze a dataset that I already possess. The script should be able to handle large amounts of data efficiently, allowing for insightful analysis and visualization. The key requirements include: - Writing new code from scratch - Prior experience in data analysis using Python - Proficiency in Python libraries such as Pandas, NumPy, and Matplotlib If you have a solid background in data analysis and Python, and are able to create efficient, clean, and well-documented code, I'd like to hear from you. Here are details- I have to create a simulation that will find the optimal solution to go around a circuit using the least amount of power ...

I'm seeking an experienced freelancer with strong attention to detail to perform data entry into my database. The data to be entered is text-based and extracted from various sources which may have distinct formats. Below are specifics about the job: - Handling Text Data: The job will entail entering a variety of text data into the designated database. - Format Diversity: The data comes from diverse sources, so it does not adhere to a specific format. The ideal candidate must be adaptable in handling different data formats. - Correcting Discrepancies: The freelancer will need to spot and correct discrepancies or inconsistencies within the data sources. Accuracy and keenness to details will be crucial. Ideal Skills: - Proficient in data entry - Strong attention to detail - Good p...

In this project, I'm searching for an experienced Python Developer who exhibits strong proficiency in web scraping, artificial intelligence, and machine learning. Key Responsibilities: - Utilize your expertise in Python, specifically focusing on AI-related tasks. - Web scraping will also be a significant part of the project, though details on the targeted data type are yet to be defined. Ideal Skillset: - Extensive experience with Python - High proficiency with AI and machine learning algorithms - Proven record of successful web scraping projects Please include samples of relevant Python, AI, or web scraping projects you've completed as part of your bid. I look forward to collaborating on this project.

I'm seeking a skilled machine learning expert with expertise in PyTorch for a natural language processing task. Your primary task is to develop a model that can understand the empathy patterns in English text. I'll provide you with the data. Key Requirements: - Proficient in PyTorch and machine learning - Experience in natural language processing - Understands the nuances of empathy detection in text data - Previous projects involving empathy learning in English text would be a plus. Deliverables: - A well-structured PyTorch model that can accurately understand the empathy in English text - Detailed documentation on the model, its architecture, and usage This project requires someone who's not only technically skilled but also understands the context and subtleties of i...

I am looking for a freelancer who can help me automate my web search for bid opportunities (RFPs) for my telecom company. Currently, I rely on searching manually, but this process is time-consuming and not as efficient as I'd like. Key Project Requirements: - You will be responsible for setting up an automated search that looks for RFPs related to "fiber optic" or other telecom-specific keywords, which are due every May 2024 or similar queries. - This automated search needs to run every 2-3 weeks, ensuring that I stay up-to-date with new bid opportunities and future due dates. - You should have a deep understanding of web scraping and automation to accomplish this task. Additional Information: - I would like to receive notifications about new bid opportunities via emai...

I'm seeking a talented data scientist specializing in ship engine assembly to analyze key parameters and offer process insights. Key Parameters and Metrics: - **Efficiency:** Analyze the efficiency of our ship engine assembly processes. - **Performance:** Look into the performance metrics of the assembly line. - **Reliability**: Assess the reliability of our ship engine assembly. Process Insights: - **Workflow Optimization:** Provide insights and recommendations on how we can optimize our workflow for better efficiency and productivity. - Collect datasets for llmRAG and embedding vector database - You should choose the models for llms and RAG and frameworks Ideal Skills: - Proven experience in data science, particularly in the manufacturing industry with a focus on ship engine as...

I'm searching for a skilled individual who can help me scrape data from a website. The data I'm interested in is text content and tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages 1-1087 Freelancer must provide a sample file of 150 records to co...

I'm in need of a proficient data scientist who can assist me in obtaining targeted gene expression data from the web-based database Culling specific gene expression characteristics, such as expression levels in different tissues and co-expression networks are the main focus. I require the downloaded data to be in CSV format. Ideal Skills: - Data extraction capabilities - Familiarity with gene expression databases - Proficient in handling large datasets - Ability to deliver data in CSV format

Here is a small NASDAQ project: 1) Recover data faster 7000 stocks => 3h for 1h30 / 90 min => 3500 stocks 9 min => 350 stocks. Maybe we could do multiple queries of 350 stocks? Because what is in place stops after 1800 files out of 7000. And obviously it starts again each time at the beginning when we restart... so it is always the same stocks which are updated. It would be better if the already downloaded data was not deleted, but kept and downloaded only the missing delta. This would allow us to have large data If we downloaded 1 year of data 7 days ago and we select 1 year, then only the last 7 days are downloaded, which goes faster. The data is then aggregated and deduplicated if necessary. 2) In the "indicator" section, be able to add, modify, delete existing indi...