Find White Papers
Home
About Us
List Your Papers
    
> Microworld > Non Intrusive Learning Patterns (NILP): The Intelligent Spam Filtering Technology of the Future

Non Intrusive Learning Patterns (NILP): The Intelligent Spam Filtering Technology of the Future

White Paper Published By: Microworld

NILP from MicroWorld is an advanced, next generation technology that detects Spam and Phishing mails using unique algorithms. Before we see how NILP works, let’s first check out the magnitude of spam trouble and why traditional methods are failing to counter it.



Tags : 
spam, email security, anti-spam, anti spam, email, intrusion prevention, mail scan, mailscan

Microworld
Published:  Dec 12, 2007
Type:  White Paper
Length:  2 pages

Non Intrusive learning Patterns (NILP) The Intelligent Spam Filtering technology of the Future NILP from MicroWorld is an advanced, next generation technology that detects Spam and Phishing mails using unique algorithms. Before we see how NILP works, let's first check out the magnitude of spam trouble and why traditional methods are failing to counter it. The Spam Scenario today Spam menace is one of the biggest issues that cripple email traffic on the Internet today. Spammers try to sell you cheap drugs, mortgages, 419 scams, a range of tacky consumer products, easy college degrees, porn, dating services and everything else imaginable! Certainly you are driven to the end of your patience when you find 95% of your inbox filled with this garbage. The immediate impact of spam can be measured by way of huge bandwidth loss, usage of network and computer resources and the wastage of productive time, both at system and human levels. Its aftereffects include financial theft, data and intellectual property theft, Phishing, Virus and other malware infections and online fraud. Spam has huge financial overtones. According to an estimate, the world lost 60 billion dollars as a direct and immediate impact of spam in 2006, while its second and third levels of impact on the economy could be much deeper and wider. And each one of us is bearing that cost! The challenges faced by spam filters One of the most difficult problems in countering spam is its nature of getting changed day-to-day, cycle-to-cycle. For example, a spammer regularly changes the contents of his email and also uses Spambots to send out the bulk messages. Spambots are programs dropped into the PCs of normal computer users by Worms and Trojans. They download spam content from the web, automatically create emails and send them out to tons of mail IDs on the Internet, all without the computer owner's knowledge. Thanks to Spambots, most bulk emails today have diverse, individual characteristics (including its country of origin, time, basic contents, originating server and more). This makes it virtually impossible for any anti-spam solution, even with the best of Bayesian or similar techniques, to pin-point a spam. Traditional anti-spam solutions try to figure out specific patterns in emails and the ones matching this pattern is marked as SPAM and the rest are marked as GOOD. This was effective till a few years ago, but with the rising popularity of "spambots" and "spambot making kits", most spam now manages get through these filters.
Spammers show a high degree of adaptability and resourcefulness in challenging anti-spam technologies. To circumvent spam filters based on checks done for specific words and phrases, spammers inserted special characters like dots and hyphens between every letter of such probable words. Then came image spam which used images with printed text on it in place of regular content. The current trend is a slew of spam mails with attached PDF files, which again manage to slip through spam filters. Non Intrusive Learning Patterns (NILP)
NILP carries with itself a continuously updating database containing DNA imprints of millions of SPAM mails detected world-wide. Once the DNA imprints are checked, NILP reverses its learning by classifying GOOD (Ham) mails, rather than using the traditional way of classifying BAD (Spam) mails. How NILP works at an organizational level Have a look at the following characteristics of any organization's mail traffic: 1. Mail/proxy Gateway 2. Mail Databases 3. Mail Users 4. Contents 5. Policies 6. Network Structure The above entities will continue to remain as the fundamental elements of a company's communication for a long time. Users may be added or deleted, public IPs may be added or deleted, but overall these basic elements remain the same. To give an example, an engineering organization will MOST certainly not subscribe or ask for information about medical drugs. A software organization will rather have no interest in receiving mails from religious institutions. Using the logic above, NILP tunes itself to understand the exact nature of the mail traffic of an organization, and then classifies all mails accordingly. It is extremely fast, scaleable and can regularly unlearn things to keep itself very efficien... [download for more]

Browse Technology Topics

Data Center

Virtualization, Cloud Computing, Infrastructure, Design and Facilities, Power and Cooling, Green Computing  
    

Data Management

Application Integration, Analytical Applications, Business Intelligence, Configuration Management, Database Development, Data Integration, Data Mining, Data Protection, Data Quality, Data Replication, Database Security, EDI, SOAP, Service Oriented Architecture, Web Service Management, Data Warehousing  
    

Enterprise Applications

Application Integration, Application Performance Management, Best Practices, Business Activity Monitoring, Business Analytics, Business Integration, Business Intelligence, Business Management, Business Metrics, Business Process Automation, Business Process Management, Call Center Management, Call Center Software, Change Management, Corporate Governance, Customer Interaction Service, Customer Relationship Management, Customer Satisfaction, Customer Service, EBusiness, Enterprise Resource Planning, Enterprise Software, EProcurement, Extranets, Groupware Workflow, HIPAA Compliance, IP Faxing, IT Spending, Marketing Automation, Performance Testing, Product Lifecycle Management, Project Management, Return On Investment, Risk Management, Sales & Marketing Software, Sales Automation, Server Virtualization, Simulation Software, Supply Chain Management, System Management Software, Total Cost of Ownership, Video Conferencing, Voice Recognition, Voice Over IP, Workforce Management, Incentive Compensation, Spend Management, Manufacturing Execution Systems, International Computing  

Human Resource Technology

Human Resources Services, Payroll Software, Time and Attendance Software, Workforce Management Software, Financial Management, Employee Monitoring Software, Employee Training Software, Recruiting Software/Services, Employee Performance Management, ELearning, Benefits Management, Expense Management  
    

IT Career Advancement

Cisco Certification, Microsoft Certification, Linux Certification, Network Security Certification, Software Development Certification  

IT Management

Employee Performance, ITIL, Productivity, Project Management, Software Compliance, Sarbanes Oxley Compliance, Service Management, Desktop Management  
    

Knowledge Management

Collaboration, Collaborative Commerce, Contact Management, Content Delivery, Content Integration, Content Management System, Corporate Portals, Customer Experience Management, Document Management, Information Management, Intranets, Messaging, Records Management, Search And Retrieval, Search Engines, Secure Content Management, SLA  

Networking

Active Directory, Bandwidth Management, Convergence, Distributed Computing, Ethernet Networking, Fibre Channel, Gigabit Networking, Governance, Grid Computing, Infrastructure, Internetworking Hardware, Interoperability, IP Networks, IP Telephony, Local Area Networking, Load Balancing, Migration, Monitoring, Network Architecture, Network Management, Network Performance, Network Performance Management, Network Provisioning, Network Security, OLAP, Optical Networking, Quality Of Service, Remote Access, Remote Network Management, Server Hardware, Servers, Small Business Networks, TCP/IP Protocol, Test And Measurement, Traffic Management, Tunneling, Utility Computing, VPN, Wide Area Networks, Green Computing, Cloud Computing, Power and Cooling, Data Center Design and Management, Colocation and Web Hosting  
    

Platforms

AS/400, Domino, Linux, Microsoft Exchange, Oracle, PeopleSoft, SAP, Siebel, Solaris, Tivoli, Unix, Web Sphere, Windows, Windows Server  

Security

Access Control, Anti Spam, Anti Spyware, Anti Virus, Application Security, Auditing, Authentication, Biometrics, Business Continuity, Compliance, DDoS, Disaster Recovery, Email Security, Encryption, Firewalls, Hacker Detection, High Availability, Identity Management, Internet Security, Intrusion Detection, Intrusion Prevention, IPSec, Network Security Appliance, Password Management, Patch Management, Phishing, PKI, Policy Based Management, Security Management, Security Policies, Single Sign On, SSL, Secure Instant Messaging, Web Service Security, PCI Compliance, Vulnerability Management  
    

Software Development

.NET, C++, Database Development, Java, Middleware, Open Source, Software Outsourcing, Quality Assurance, Scripting, SOAP, Software Testing, Visual Basic, Web Development, Web Services, Web Service Security, XML  

Storage

Backup And Recovery, Blade Servers, Clustering, IP Storage, ISCSI, Network Attached Storage, RAID, Storage Area Networks, Storage Management, Storage Virtualization, Email Archiving, Data Deduplication  
    

Wireless

802.11, Bluetooth, CDMA, GPS, Mobile Computing, Mobile Data Systems, Mobile Workers, PDA, RFID, Smart Phones, WiFi, Wireless Application Software, Wireless Communications, Wireless Hardware, Wireless Infrastructure, Wireless Messaging, Wireless Phones, Wireless Security, Wireless Service Providers, WLAN  
Search