Reflection paper
Lecture 09 - Memory Forensics.pdf
L E C T U R E 9 B Y : D R . I B R A H I M B A G G I L I
Memory Forensic Analysis
P A R T 1
RAM overview
Volatility overview
http://www.bsatroop780.org/skills/images/ComputerMemory.gif
Understanding RAM
• Two main types of RAM – Static
• Not refreshed • Is still volatile
– Dynamic • Modern computers • Made up of a collection of cells • Each cell contains a transistor and a capacitor • Capacitors charge and discharge (1 and zeros) • Periodically refreshed
RAM logical organization
• Programs run on computers • Programs are made up of processes
– Processes are a set of resources used when executing an instance of a program
– Processes do not generally access the physical memory directly – Each process has a �virtual memory space�
• Allows operating system to stay in control of allocating memory – Virtual memory space is made up of
• Pages (default size 4K) • References (used to map virtual address to physical address) • May also have a reference to data on the disk (Page file) – used to
free up RAM memory
RAM logical organization
! Each process is represented by an EPROCESS Block:
Normal memory
• Each process is represented by an _EPROCESS block. • Contained within each _EPROCESS block is both a pointer to the next process (fLink – Forward Link) and a pointer to the previous process (bLink – Back Link). • When OS is operating, the _EPROCESS blocks and their pointers come together to resemble a chain, which is known as a doubly-linked list. • Chain is stored in kernel memory and is updated every time a process is launched or terminated. • Windows API walks this list from head to tail when enumerating processes via Task Manager, for example.
Not so normal
• Hides processes from windows API • Known as Direct Kernel Object Manipulation (DKOM) • Involves manipulating the list of _EPROCESS blocks to �unlink� a given process from the list • By changing the forward link of process 1 to point to the third process, and changing the �bLink� of process 3 to point to process 1, the attacker�s process is no longer part of the list of _EPROCESS blocks. • Since the Windows API uses this list to enumerate processes, the malicious process will be hidden from the user but still able to operate normally.
P A R T 2
Introduction to Memory forensics
Before & Now
! Traditionally ! We have always been told to �pull the plug� on a live system ! This is done so that the reliability of the digital evidence is not
questioned
! Now ! People are considering live memory forensics
" Data relevant to the investigation may lie in memory " Whole Disk Encryption….
Challenges in traditional method
• High volume of data (Aldestein, 2006) – Increases the time in an investigation – Increases storage capacity needed for forensic images – Number of machines that could be included in the investigation
(Sommer, 2004) • Ubiquity of digital evidence
– Many types of digital devices (Mp3, gaming consoles etc.) • Evidence in memory only
– Messaging applications (Carvey, 2004) – Malaware in memory (Burdach, 2004) – Privacy mode of browsers (Google, 2008; Zeigler, 2008)
• Size of RAM is increasing (Sutherland et al. , 2008) – Potential for more digital evidence
• Encryption!
Live investigations VS. dead investigations
• According to Carrier (2005 p.5), �A dead analysis occurs when you are running trusted applications in a trusted operating system to find evidence� and a live analysis is defined as �when you use the operating system or other resources of the system being investigated to find evidence.� – That is a little contradictory. What if a live CD was used on the
suspect machine to perform �dead� analysis?
Live investigation VS. dead investigations
• Mandia et al. (2003 p.27) simply states that �a live response is conducted when a computer system is still powered on and running.� This would suggest that a bootable Linux CD is indeed a live investigation.
• Carrier 2nd definition: using the operating system of the system being investigated to acquire, analyze or present digital evidence will be used to describe a live investigation.
When is RAM analysis useful?
! Cases where large volumes of data is involved (many computers)
! Mission critical systems ! Relevant digital evidence is stored in memory only ! When machine under investigation is using
encryption (finding the decryption key) ! Click here for video
Live investigations
! Involve examining a digital system while it is running and using the OS ! Acquire ! Analyze ! Present
! They are permitted by the 2nd principle of the ACPO guidelines ! Principle 2 of the Association of Chief Police Officers� Good
Practice Guide for Computer-Based Electronic Evidence states, �In circumstances where it is necessary to access original data held on a computer or storage media, that person must be competent to do so and be able to give evidence explaining the relevance and the implications of their actions� (ACPO, 2007).
Encryption example 1
! At Senate hearings in September 1997, Jeffery Herig, special agent with the Florida Department of Law Enforcement, testified that they were unable to access protected files within a personal finance program in an embezzlement case at Florida State University. He said the files could possibly hold useful information concerning the location of the embezzled funds.
Encryption example 2
• [It is] also reported that they had encountered unbreakable encryption in a US customs case involving an illegal, world-wide advanced fee scheme. At least 300 victims were allegedly bilked out of over $60 million. Herig said they had encountered three different encryption systems. Although they were able to defeat the first two, they were unsuccessful with the third. The vendor told them that there were no back doors.
Encryption example 3
• An employee of a company copied proprietary software to a floppy disk, took the disk home, and then stored the file on his computer encrypted under PGP. Evidently, his intention was to use the software to offer competing services, which were valued at tens of millions of dollars annually (the software itself cost over $1 million to develop). At the time we heard about the case, the authorities had not determined the passphrase needed to decrypt the files. Information contained in logs had led them to suspect the file was the pilfered software.
Example 4..etc
! At one university, the investigation of a professor thought to be trafficking in child pornography was aborted because the campus police could not decrypt his files.
! Many more child pornography cases…
Decryption options?
• Ask for the key during the interview with the suspect • Locate unencrypted copies of the encrypted data (deleted
stuff?) • Locate copy of the key on the disk, or surrounding areas
– Build a dictionary -- use the dictionary • Intelligent passoword attacks
– Uses words from suspect�s personal details • Brute force attack • Vulnerabilities in the implementation of the encryption
system • Surveillance (keyloggers etc.)
– Hardware and software
Live investigation methodology
! Wait (2008) methodology ! Establish a trusted command prompt ! Establish a method for transmitting and storing the collected
information ! Running various tools and creating hashes of the output
Live investigation tools
• cmd.exe'A'trusted'copy'of'the'command'prompt.'This'will'change'for'different'versions'of' Windows.)Built'in.' • PsLoggedOn'A'u?lity'that'shows'all'users'connected'locally'and'remotely.'www.foundstone.com' • Rasusers'A'command'that'shows'which'users'have'remoteaccess'privileges'on'the'target'system.' NT'Resource'Kit'(NTRK)' • Netstat'A'system'tool'that'enumerates'all'listening'ports'and'all'current'connec?ons'to'those'ports.' Built'in' • Fport'A'u?lity'that'enumerates'all'processes'that'opened'any'TCP/IP'ports'on'a'Windows)NT/2000) system.)www.foundstone.com' • PsList'A'u?lity'that'enumerates'all'running'processes'on'the'target'system.'www.foundstone.com' • ListDLLs'A'u?lity'that'lists'all'running'processes,'their'command'line'arguments,'and'the' dynamically'linked'libraries'(DLLs)'on'which'each'process'depends.'www.foundstone.com' • Nbtstat'A'u?lity'that'lists'the'recent'NetBIOS'connec?ons'for'approximately'the'last'10'minutes.' Built'in' • Arp'A'system'tool'that'shows'the'MAC'addresses'of'systems'that'the'target'system'has'been' communica?ng'with,'within'the'last'minute.'Built'in' • Kill'A'command'that'terminates'a'process.'NTRKMd5sum'A'u?lity'that'creates'MD5'hashes'for'a' given'file.'www.cygwin.com' • rmtshare'A'command'that'displays'the'shares'accessible'on'a'remote'machine.'NTRK'
P A R T 3
Memory acquisition
Live disk acquisition
! FTK Imager (now also RAM) ! dd ! Helix Live CD
Live memory acquisition
• \\.\PhysicalMemory (user mode): Similar to \dev \memory in Linux, this object – provides access to the physical memory of Windows XP
(Vidstrom, 2006a). – Can be accessed and copied using user-mode programs such as
a modified version of dd (Carvey, 2007b). – Has the advantage that no software needs to be installed on the
system under investigation (Schuster, 2005). – Practical problem: requires administrator privileges on the live
suspect machine (Schuster, 2005). User mode access to the \\. \PhysicalMemory object is also not possible unavailable under Windows Server 2003 SP1 onwards, including Windows Vista (Schuster, 2005)
Live memory acquisition
! \\.\PhysicalMemory (kernel mode): Recently a number of options have become available that overcome the problem of lack of user mode access to the ! \\.\PhysicalMemory object. These allow imaging of the
memory of a Windows Vista machine using a kernel mode driver to access the \\.\PhysicalMemory object (Schuster, 2008b).
Live memory acquisition
• Tools that use \\.\PhysicalMemory (kernel mode): – WinEn: This is included with EnCase versions 6.11 onward.
It is also included on the latest version (2.0) of the Helix Live CD (e-fense, 2008).
– mdd (Stotts, 2008): The Memory DD tool from ManTech is open source and available on SourceForge (ManTech, 2008).
– win32dd (Suiche, 2008b): This tool is also open source but uses more kernel mode functions, including writing the output file, rather than mdd, in which �the [kernel] driver is only used to get \Device\PhysicalMemory handle (Suiche, 2008a).
Live memory acquisition
• Firewire (IEEE 1394): Firewire devices use Direct Memory Access (DMA) – Can access the memory of a system without using the CPU (Carvey,
2007b). – Bolieau (undated) describes a way to use this property to obtain an
image of a machine�s physical memory. – Images memory, even if a machine is locked. – More difficult to configure and use than the \\.\PhysicalMemory
tools – Target system must have a working Firewire port. – Documented problems in Vidstrom (2006b), e.g. dumping the Upper
Memory Area (UMA) – Can cause a fatal error and blue screen if non existent memory
addresses are accessed (Schuster, 2008a).
Live memory acquisition
! Process Memory Acquisition Tools: ! Dump the memory used by a specific process. Examples of
such tools include pmdump (Vidstrom, 2002) and userdump (Microsoft, 2007c).
Live memory acquisition
• Cooling + Reboot (Video) – Halderman et al (2008) and explains that even though data in RAM does decay when the
power is removed, �retention times can be increased by cooling� (Halderman et al., 2008). – By cooling RAM chips to -50ºC using an inverted can of compressed air and using a warm
or cold reboot, the bit deterioration may be reduced sufficiently so that by rebooting the system to a custom operating system with a minimal memory footprint (network based or on USB) the contents of RAM can still be imaged, albeit with some bit errors.
– This has the advantage of providing a trusted operating system in which to perform imaging. • At time of writing the tool from Halderman et al (2008) (ram2usb) was
not available but an alternative that uses the same principles is available from McGrew (2008). There are also additional problems to the bit errors: it is possible that the machine has been configured not to boot to network or USB, preventing an operating system from being loaded that can perform the memory imaging. It is also possible that the machine may perform a destructive memory test when restarting.
Live memory acquisition
• Crash Dumps: A system can be configured in advance through the Windows Registry or Start-up and Recovery settings to create a full dump of its memory to disk on a key press (on PS\2 keyboards) (Microsoft, 2007e).
• This has the significant advantage that the entire system is halted when the contents of RAM are being written (Carvey, 2007b), this means that this is a true �image� of memory rather than a �smear�, since the data is not constantly changing as it is being copied.
• It is necessary to reboot the system for the Registry change to take effect (Microsoft, 2007e)
• Difficult to use in real cases when system is not configures • There is also a further limitation described in Huebner et al. (2007)
that �the key sequence used to generate the crash dump is insecure and could be intercepted by an application program�.
Live memory acquisition
! Hibernation File: When a Windows system is put into hibernate mode, the system�s state is stored in hiberfil.sys file. ! Using the Sandman Framework the hibernation file can be converted to
a flat, dd style image (Suiche and Ruff, 2008). ! Advantage: system is completely stopped.
" Image is coherent and does not suffer the same �smearing� as other techniques. ! Examined offline, it is not possible for malware to hide from an analysis. ! If the system�s power is disconnected and the hibernation file later
imaged, the hibernation file may be significantly out of date ! Intentionally putting the system to sleep will overwrite data in the current
hibernation file on the disk. ! Ruff and Suiche (2007) also states that there is �no guarantee that 100%
of physical memory has been saved�. ! Hibernation file is not available when certain types of encryption product
are in use.
Live memory acquisition
• Hardware Devices: Carrier and Grand (2004) describes a PCI card that can be fitted to a PC which can dump memory to an external storage device.
• Since this approach is hardware based it does not rely on potentially untrusted code.
• The hardware needs to be installed before an incident occurs (Carvey, 2007b) and as a result this is unlikely to be an option.
P A R T 4
Memory analysis techniques
Memory analysis techniques
• String searches: – Early analyses of memory dumps consisted of simply
extracting text strings (Carvey, 2007b p.88). – This is achieved using tools such as strings (Russinovich,
2007), grep (on Linux) or bintext (Foundstone, 2000) and enables searches for passwords, IP and e-mail addresses and other text strings.
– The difficulty with evidence obtained in this way is that it is difficult to attribute to a specific process (Carvey, 2007b p.89).
Memory analysis techniques
• Process Enumeration: – If one EPROCESS block can be found in memory, the Forward
Link (FLINK) and Backwards Link (BLINK) pointers can be used to enumerate all processes in the memory dump.
– Relies on locating an EPROCESS block. – There are a number of methods described for achieving this.
• First dump system process (ID4) using a perl script • Then locate the other processes
Memory analysis techniques
• Process Carving: – Schuster (2006) provides an alternative to the process
enumeration approach that is similar to file carving in disk images.
– Scans through a memory image testing for valid process and thread structures using a 20 rule criteria.
– Implemented in PTFinder.pl. There is also another implementation of this approach in Carvey (2007b p.104), lsproc.pl, which is limited to identifying processes rather than threads.
Memory analysis techniques
• VAD Tree Based Process Recovery: – Recovery of memory that belongs to a specific process. – VAD tree provides access to areas of memory assigned to a
process. – Root of the VAD tree is stored in the process�s EPROCESS
block at offset 0x11C. – From this pointer the VAD tree can be traversed and the areas
of memory assigned to the process can be extracted (Dolan- Gavitt, 2007).
– VAD tree offset has changed in Server 2003, and Vista.
P A R T 5
Memory analysis toolkits
Create your own?
! Understand how memory is stored ! Program your own way of parsing processes out etc. ! Use string searches
Responder
! Commercial product, one of the first ones released to analyze memory dumps
! Allows investigators to view both physical and virtual memory dumps
Volatility framework ! Leading open source toolkit, implemented in python,
works on Windows XP SP2 and SP3 dumps (Outdated) ' connec?ons:'Print'list'of'open'connec?ons.' connsca:'Scan'for'connec?on'objects.' date?me:'Get'date/?me'informa?on'for'image.' dlllist:'Print'list'of'loaded'DLLs'for'each'process.' dmp2raw:'Convert'a'crash'dump'to'a'raw'dump.' dmpchk:'Dump'crash'dump'informa?on.' diles:'Print'list'of'open'files'for'each'process.' hibinfo:'Convert'hiberna?on'file'to'linear'raw'image.' ident:'Iden?fy'image'proper?es.' memdmp:'Dump'the'addressable'memory'for'a'process.' memmap:'Print'the'memory'map.' modscan:'Scan'for'modules.' modules:'Print'list'of'loaded'modules.' regobjkeys:'Print'list'of'open'Registry'keys'for'each' process.' ' ' ''
procdump:'Dump'a'process'to'an'executable' sample.' pslist:'Print'list'of'running'processes.' psscan:'Scan'for'EPROCESS'objects.' raw2dmp:'Convert'raw'dump'to'a'crash'' dump.' sockets:'Print'list'of'open'sockets.' sockscan:'Scan'for'socket'objects.' thrdscan:'Scan'for'ETHREAD'objects.' vaddump:'Dump'the'VAD'sec?ons'to'files.' vadinfo:'Dump'the'VAD'info.' vadwalk:Walk'the'VAD'tree.' Strings:'Match'physical'offsets'to'virtual' addresses.' '
Vola%lity)command)Informa%on)Obtained)
P A R T 6
Challenges in live digital investigations
Challenge 1: Trusting the results
• Mohay et al. (2003) states that �any system being examined live should be considered to be hostile until proven otherwise.�
• Carrier (2006) goes as far as saying that �the only difference between live and dead analysis is the reliability of results.�
• Extensive use of DLLs in windows • Operating system has to be modified in some way to
provide false info – Rootkit/Malware installed on a system, either intentionally or
unintentionally – Logic bombs
Challenge 2: Intrusiveness of techniques
! Contaminating the digital evidence (volatile nature) ! Can�t use write blockers ! Modifying as little as possible (Carvey, 2004) ! Minimally invasive techniques ! No way to avoid making changes ! Amount of change will vary depending on hardware
and software used
Challenge 3: Verification of results
! Results should be verifiable and repeatable (Pollitt, 1995)
! Evidence gathered represents a live system that cannot be reproduced at a later date
! Image can only be verified against itself, and not the �original� media
! Could prevent it from being admissable
Challenge 4: Ensuring a complete set of evidence
! Selective file copying, rather than the complete image
! Some data not captured may have proved innocence…
! First responders are used to: Identifying and preserving digital evidence ! Now they have to identify relevant digital evidence
The end.
Lecture 6 - AntiForensics.pdf
Anti-‐Forensics Modified by Dr. Ibrahim Baggili
Originally created by Marcus Rogers – Purdue University
1
Some refreshers • What is Cyber/Digital Forensics? • What are some of the issues with Digital Forensics? • What are the three As? • What is a file system? • What is CHS?
2
Lecture Outline • What is anJ-‐forensics? • Taxonomy of AnJ-‐forensics • Countering AnJ-‐forensics • Looking ahead • Summary
3
AnJ-‐forensics • APempts to negaJvely effect the existence, amount and/or quality of evidence from a crime scene, or make the analysis and examinaJon of evidence difficult or impossible to conduct.
• Digital evidence (DE) is not immune to this • The volaJlity of DE and the reliance on tools makes cyber forensics very vulnerable to AF
• Issue for all the Digital Forensics CommuniJes • LE, Private Sector, Military/Intelligence
4
Overall Taxonomy • Data hiding • ArJfact wiping • Trail obfuscaJon • APacks against the CF process/tools **
5
Data Hiding Taxonomy Nothing new here! • Rootkits have been around for quite some Jme • APempt to hide data in unusual places
• Memory • Slack space • Hidden directories • Modifying metadata • Bad blocks • Alternate Data Streams • Hidden parJJons • Data EncrypJon
• Steganography • No one is sure how big a problem this is • Mixed results on idenJfying stego
6
Common Data Hiding Techniques • Rename files/directories • Delete files/directories • Copy files/directories • Print files • Format a disk
7
Renaming Files • Rename files and/or file extensions • Example: • Rename extorJon_lePer.doc to fuzzy_bunny.jpg • People looking for incriminaJng evidence probably won’t
check a picture file called fuzzy_bunny.jpg
8
Copying files • Scenario #1: Copying a file to a floppy disk or hard disk.
– If you run out of space, the pointer to the file is removed, but the data that was copied to the sectors is lec in place
• Scenario #2: Computer crashes while copying a file. – Again, the file contents copied to the unallocated sectors will
exist, but the pointer to the data will not have been created.
9
PrinJng a file • When prinJng a file, it is spooled to the hard disk before it is
printed. • Spooling involves copying the file to a temporary locaJon,
prinJng it, then deleJng it. • Acer the temporary file is deleted, the data sJll exists on disk
• Most printer drivers convert print to graphics these days prior to prinJng so…..
10
Formafng a disk • When a disk is quick formaPed, the file table on the disk is
cleared, but the data on the disk is lec in place. • Again, similar to deleJng all the files on a disk.
• Data can also be recovered from a full format • Low level formafng is a different story!
11
APributes • In Windows, set the “hidden” aPribute on a file or
directory. • Can sJll view files if the “Show hidden files and folders”
opJon is checked in Windows Explorer. • Other tools may or may not display hidden files.
12
Folders • In Unix, rename a file or directory starJng with a “.”
• Example: mv important.doc .important.doc • Can sJll be viewed by lisJng all files “ls –a” • Other methods???
• ., …, ., .., etc. • Root kits love making these kind of hidden folders
13
FS UNIX • In Unix it is possible to hide files and directories “under” a
filesystem • Example:
• mkdir /temp • Create files/directories in /temp • Mount a filesystem at /temp • The files are not visible, and cannot be read/written • The files are accessible again after the filesystem has been
unmounted
• This might be detectable, but not always. • Example: / is 10 GB, space used is 2 GB, but only 4 GB are
free. This could indicate the presence of files hidden under a filesystem
14
Swap space • Swap Space (also called a page file) is used to increase the
amount of memory available to the system • The total memory available (real RAM and the swap space) is
called virtual memory. • InformaJon is constantly being wriPen to memory, and
therefore to the hard disk. • InformaJon can then be extracted from this file
15
Core dumps • Core dumps are created on Unix systems when a process or
program generates a fault • The core dump will contain all the data from CPU registers
and memory at the Jme of the fault • InformaJon can then be extracted from core dump
16
Slack space • When files are deleted, both the deleted data and the data in
slack space sJll exists • When a file is wiped from the system (permanently removed),
any data in the slack space sJll exists • The data in the slack space will only be removed when it is
overwriPen, or it is explicitly removed
17
Alternate data streams (ADS) • Microsoc introduced the Alternate Data Stream (ADS) into
NTFS in the early 1990’s • Created so Microsoc Windows NT could be a file server for
Macintosh files • Mac’s Hierarchical File System (HFS) uses alternate streams
called Resource Forks to store addiJonal file informaJon, such as icons
18
ADS • Unlike FAT (and other filesystems) which only have one data
stream, NTFS allows the creaJon of mulJple data streams • ADSs in NTFS can be used to store summary informaJon
about files • This informaJon is not transportable to other filesystem types
(eg. FAT, ext2)
19
ADS
20
ADS • Most file system uJliJes (such as Windows Explorer) will only report on the default data stream
• The reported file size will remain the same, regardless of the number of ADSs aPached to a file
• Microsoc does not provide any tools to detect ADS’s
• LADS, created by Frank Heyne, is a command-‐line tool that will search a NTFS filesystem for ADSs
• LADS is available from hPp://www.heysoc.de/en/ socware/lads.php?lang=EN 21
ADS
• CreaJng an ADS – echo text in default stream > myfile.txt
– echo extra text in ADS > myfile.txt:hidden.txt
22
ADS • C:\temp>echo some text > myfile.txt
• C:\temp>dir myfile.txt • Volume in drive C has no label. • Volume Serial Number is 40AB-8351
• Directory of C:\temp
• 2003-03-04 03:11p 12 myfile.txt • 1 File(s) 12 bytes • 0 Dir(s) 3,227,021,312 bytes free
• C:\temp>type bigfile.tgz > myfile.txt:hidden
• C:\temp>dir myfile.txt • Volume in drive C has no label. • Volume Serial Number is 40AB-8351
• Directory of C:\temp
• 2003-03-04 03:12p 12 myfile.txt • 1 File(s) 12 bytes • 0 Dir(s) 3,183,009,792 bytes free
• C:\temp>
23
ADS • C:\temp>lads
• LADS - Freeware version 3.10 • (C) Copyright 1998-2002 Frank Heyne Software (http://
www.heysoft.de) • This program lists files with alternate data streams (ADS) • Use LADS on your own risk!
• Scanning directory C:\temp\
• size ADS in file • ---------- --------------------------------- • 44010926 C:\temp\myfile.txt:hidden
• 44010926 bytes in 1 ADS listed
• C:\temp>
24
ADS • Running a hidden command in ADS (try this on a NTFS file
system): – C:\>echo some text > c:\temp\file.txt – C:\>type c:\winnt\system32\calc.exe > c:\temp
\file.txt:hidden.exe – C:\>type c:\temp\file.txt – C:\>start /b c:\temp\file.txt:hidden.exe
• This will start the Windows calculator program from a 12 byte file!
25
Summary • There are various areas that can be used to conceal data. • Start simple then work to the more complex. • Understanding common hiding techniques and where arJfacts
can be found is crucial.
26
Win2K/XP recycle bin • “Recycled” Folder for FAT:
• INFO2 • Place holder(s) • Desktop.ini
27
Win 2K/XP recycle bin • “Recycler” Folder for NTFS
• SID named subdirectory contains: (For each user there is a security ID (SID))
• Place holder(s) • INFO2 • Desktop.ini
• NTFS Recycle Bin
28
Placeholders • D<original drive lePer><#>.<original extension>
• DC1.TXT • DC2.JPG • DC3.BMP
• Entry for each deleted item: – Hidden from view in GUI environment – Date & Jme unchanged from original file
• If a subdirectory is deleted only one placeholder is made 29
INFO 2 File • 800 Byte Entry is made for each Recycled object
– Recycled date – Original path and filename – Place holder drive lePer and #
30
INFO 2 file
Counter Drive Letter
Recycled Date and Time (GMT)
Offset 260 – 275 of an INFO2 entry
31
INFO 2 File • Recycled date and Jme issue
– The date and Jme are stored in GMT in hexadecimal format – Recycle Bin tools (IEHistory, Datalicer) will convert the Jme for you!
– Something wrong here?
Hint! HKEY_LOCAL_MACHINE\SYSTEM\ControlSet001\Control\TimeZoneInformation 32
Desktop.ini • Created when Recycle Bin is created • Only modified if recycle bin is EMPTIED
– All Date / Time informaJon updated when bin is empJed
33
Recovering from recycle bin • Copy placeholders to separate drive • Copy INFO2 file; use uJlity to parse out date / Jme data
– Datalicer – IE History
34
Steganography • Hiding informaJon in plain site • Centuries old
– Spartans – Greeks
• Extremely hard to detect • AcJve research for NaJonal Security reasons
– StaJsJcal Analysis • DetecJon Algorithms
35
Steganography • Types of Encoding
• Least Significant Bit (LSB) • Encode the message in the least significant bit of every byte in an image. The value of each pixel is changed slightly, but not enough to make significant changes to the image.
• Frequency Domain encoding • This method encodes messages within images by working with the 2-‐dimensional Fast Fourier Transform, or 2-‐D FFT of the container image.
Source:hPp://www.owlnet.rice.edu/~elec301/Projects01/steganosaurus/background.html 36
Stegonography • InjecJon
– Unused areas in a file (end of a song) • SubsJtuJon
– Least significant bits • GeneraJon
– Creates an new file
37
Steganalysis • DetecJon methods??
– Remnants of stego socware on system (registry) – Comparison files
• (MD5), Visually – size diff??
– LocaJng stego socware on system – StaJsJcal analysis
• average bytes • skew, kurtosis • average deviaJon
• Problem of false posiJves
38
39
40
41
42
43
Summary • DeleJng and formafng on a Hard Drive does not touch the
data area. • Ocen evidence can be found in deleted files, and the recycle
bin. • Steganography is a real problem • Work from the obvious to the less obvious • Go for the low hanging fruit first • When are you done???
44
References • NW3C Basic Data Recovery & Analysis Course • NW3C Advanced Data Recovery & Analysis (NTFS) • Kessler, G. (2001). An overview of steganography for the computer forensics examiner. Retrieved July 1, 2005 from hPp://www.wi.gov/hq/lab/fsc/backissu/july2004/research/ 2004_03_research01.htm
45
ArJfact wiping taxonomy • ArJfact wiping • Disk cleaners
• EffecJve but obvious that it was used • Free space and memory cleaners
• Less obvious • Most don’t work properly and leave signatures behind (Geiger, 2005 -‐ DFRWS) • Nothing really new
• ProphylacJc • Not producing any arJfacts/remnants
• No writes to the disk or readable memory 46
Trail obfuscaJon • Trail obfuscaJon
– Where is the source located – Who is the source
• Log cleaners • Spoofing • MisinformaJon • Backbone hoping • Zombied accounts • Trojan commands
Not new either!
47
APacks against CF Process/tools • Houston we have a problem! • RelaJvely new • VicJm of our own success in making CF standardized and public
• Vendor & Tool dependency has made us very vulnerable! • RelaJve immaturity of the discipline has not helped • Focus area for the computer underground because of its relaJve ease
48
Tools and processes • Evidence PreservaJon & CollecJon
• Some novel aPacks discussed but few so far have been documented in the “wild” • Bad blocks • Odd disk sectors • Altering the HPA or DCO at the drive level (Host Protected Area, Device ConfiguraJon Overlay)
• This CF process is very tool centric • EnCase, FTK, DD, or other integrated device
• APacks seek to prevent the creaJon of bitstream images or prevent integrity checking • Image appears to be +4 Terabytes • Hashes never match
• For the most part it is obvious that something is amiss 49
ExaminaJon and Analysis • Can be a much more subtle aPack • Relies on vulnerabiliJes of the examinaJon and analysis tools • AssumpJon is most LE and CF pracJJoners are “tool monkeys” who don’t understand what is happening under the hood
• Documented aPacks against • FTK, EnCase, iLook, WinHex, TCT, Sleuthkit, etc.
• Compression bombs • Nested directories • Altering the MFT and inodes • File signature altering, hash fooling
• The more automated the tool the more suscepJble it is to aPack!
50
AnJ-‐forensics: The soluJon? • AnJ-‐AnJ-‐ Forensics
• Understand what the tools are doing or supposed to do • Error logging on tools • Don’t automate everything by default
• Funded research on AF • Most research is to date is grass roots and ad hoc
• Focus research on the Windows world as opposed to *NIX • Majority of LE and Private sector cases involve Windows OS
• Academic research has tended to be *NIX centric as it is bePer understood, relaJvely open, and documented
• Don’t publish all of our tricks??
51
The future • AnJ-‐forensics is here to stay
– We are now in an arms race of sorts – Data wiping tools (free space etc.) will get bePer – APacks will get more subtle – Unfortunately tools will get more automated, more levels of abstracJon
• Data mining, Expert systems, Evidence aggregaJon tools, AI • Data mining and evidence aggregaJon are needed due to the increasing storage capaciJes and thus increase in volume of data
52
Summary • Most anJ-‐forensics techniques are not new • Most are obvious • Increased aPenJon by the underground • More research is needed • More informaJon sharing within the community is needed • BePer training for pracJJoners • Vendors need to listen to the community bePer • This issue is here to stay!
53
Suggested Readings • Butler, G. H. J. (2005). Rootkits: SubverJng the windows kernel: Addison Wesley Professional.
• Foster, J., & Liu, V. (2005). Catch me, if you can... Retrieved Sept 5th, 2005, from www.metasploit.com/projects/ anJforensics/BH2005-‐
• Catch_Me_If_You_Can.ppt • Geiger, M. (2005, August 18th). Evalua&ng commercial counter-‐ foreniscs tools. Paper presented at the DFRWS, New Orleans.
• Grugq. (2005). The art of defiling. Blackhat Briefings Retrieved Sept 9, 2005, from www.blackhat.com/presentaJons/ bh-‐asia-‐03/bh-‐asia-‐03-‐ grugq/bh-‐asia-‐03-‐grugq.pdf
• Mcleod, S. (2005). Smart anJ-‐forensics. Retrieved June 1, 2005, from hPp://members.ozemail.com.au/~steven.mcleod/ SMART_AnJ_Forensics.pdf
• Peikari, A. C. C. (2004). Security warrior: O'Reilly. • Peron, C., & Legary, M. (n.d.). Digital anJ-‐forensics: Emerging trends in data transformaJon techniques. Retrieved Sept 1, 2005, from
• www.seccuris.com/documents/papers/Seccuris-‐AnJforensics.pdf 54
Lecture 6.2 - Anti Forensics New Taxonomy.pdf
Kevin Conlan MS, Ibrahim Baggili PhD, Frank Breitinger PhD
Graduate Researcher & UNHcFREG Member Presenting @ DFRWS USA 2016, Seattle
Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy
Cyber Forensics Research & Education Group
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy
1
Anti-forensics: Tools and techniques used to invalidate the digital forensic process.
So…would using this tool, Tracks Eraser Pro, be an example of anti-forensics?
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 2
How about this encryption tool?
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 3
And this popular disk cleaner/registry wiper?
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 4
And this VPN?
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 5
Agenda
• Problem statement • Contribution • Related work • Methodology • Results & discussion • Limitations • Conclusions & future work
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 6
Problem statement
Not enough research on anti-forensics. Baggili et al. (2012): Out of 500 digital forensic research papers, only 2% pertained to anti-forensics.
Anti-forensic tools and techniques can be used to: • Remove • Alter • Disrupt Or otherwise interfere with evidence of criminal activities on digital systems.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 7
Contribution
I. A categorical data set of 308 anti- forensic tools.
II. An extended version of the Rogers (2006) anti-forensic taxonomy (Figure 1).
III. The calculated hash values of 2780 unique installation-related files of the anti-forensic tools, and an analysis of their presence in the newest 2016 NSRL1.
1http://www.nrsrl.nist.gov/(last accessed 2016-02-10).10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 8
• Data hiding • Encryption • Steganography • Other forms of data hiding
• Artifact Wiping • Disk cleaning utilities • File wiping • Disk degaussing / destruction
techniques • Trail obfuscation • Attacks against computer forensic tools
and processes
Figure 1:
Related Work
Harris (2006): there are no general or contemporary frameworks with which to analyze anti-forensics.
Harris (2006) notes that while there a few general groupings of anti- forensic methods, there are no identifiable groupings of anti-forensic software.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 9
Methodology Our methodology included the following overarching steps:
I. Data set creation II. Data set organization III. Data set analysis IV. Hashing V. Data set comparison with NSRL VI. Extended taxonomy creation
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 10
Methodology
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 11
Figure 2: Extended Taxonomy of anti- forensics
Results and discussion
Comparing anti-forensic tools hashes to the NSRL Python script was written to acquire 2780 unique MD5 and SHA1 hash values of the anti-forensic tool installation related files, and was compared against the newest 2016 Reference Data Set (RDS). Only 423 hashes were found.
The unmatched hashes would be example Presence of anti- forensic tools/files/installation files under the category of Possible indicators of anti-digital forensics.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 12
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 13
Figure 3: Number of tools found per anti- forensic category
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 14
0 20 40 60 80 100 120 140 160 180
Windows Phone Windows
Unix Symbian
SUSE Solaris POSIX OSV
OpenSolaris OpenIndiana
OpenBSD NetBSD
Multi-platform/unspecified Maemo
Mac Linux iOS
Illuminos distributions HP-UX
FreeBSD DragonFly BSD
Blackberry Android
Figure 4: Instances of operating systems/platforms
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 15
0 5 10 15 20 25 30 35
USA Ukraine
UK Thailand
Switzerland Sweden Spain
Singapore Russia Poland
New Zealand Moldova
Japan Italy Israel India
Germany France Finland
Denmark Croatia China
Canada Brazil
Austria Australia
Figure 5: Tools by identifiable country of origin
Limitations
A considerable limitation was the number of software tools that may be considered “anti-forensic” in nature is vast and continuously growing.
It is difficult to determine the entire scope of the anti- forensics domain. However, this is not as much a “limitation” as it is an opportunity for future research endeavors.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 16
Conclusions and future work
The goals of this work was the following:
A categorical data set that would be useful to the digital forensic community through the collection and organization of 308 anti-forensic tools.
An extended classification of the original anti-forensics taxonomy, to more fully encapsulate the domain of anti- forensics.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 17
Conclusions and future work
Future work: Expanding the scope of the categorical data set to include more tools, of which there are many.
“Internet-of-things”: anti-forensic tools will follow this digital migration. Expand taxonomy to include the forms of digital devices that anti-forensics could exist on.
A similar methodology applied to other fields of the information assurance domain (e.g., hacking/penetration tools).
Ways of automating the classification of anti-forensic tools with computational linguistics, by parsing metadata of tools online and leveraging machine learning.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 18
Acknowledgments
Sidharth S. Nandury and Mohammad M. Hassan
Douglas White (NIST)
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 19
Questions?
Thank you!
Data sets for this research are available at www.unhcfreg.com under Data & Tools.
10/26/16 Anti-forensics: Furthering digital forensic science through a new extended, granular taxonomy 20
Lecture 7 - E-mail Forensics.pdf
E-‐mail Forensics
By: Dr. Baggili
Source: h2p://www.cim.mcgill.ca/~jer/email.html 1
Some other project ideas: • Vola<le memory fingerprints of chat clients • Comparison of soBware/hardware imaging solu<ons • Android forensics • Blackberry chat forensics • Network ar<facts – predic<ng the opera<ng system based on network traffic
• Detec<ng e-‐mail servers used based on e-‐mail header informa<on • Wri<ng soBware for the extrac<on of EXIF data from jpeg images • Logical versus Physical acquisi<on tools • A survey inves<ga<ng the type of data that is saved on computers/ mobiles/other devices
2
E-‐mail Forensics • E-‐mail history • E-‐mail evidence • E-‐mail tracing
3
History of e-‐mail • Older than ARPANET • It was like leaving a note on someone’s desk – when a person logged on, they would find the e-‐mail (mul<ple people using the same computer) • MIT – MailBox (1965) • SNDMSG
• Ray Tomilson (inventor of e-‐mail 1972) • Chose @ symbol • user@computer
Ian Peter: h2p://www.nethistory.info/History%20of%20the%20Internet/email.html
4
History of e-‐mail • 1974 – extensive use by military because ARPANET encouraged it
• Lary Roberts invented e-‐mail folders for his boss • 1975 – John vital invented a way to organize e-‐mail • 1976 – e-‐mail took off (and 75% of all ARPANET traffic was e-‐ mail)
• Offline readers • SMTP & POP • Euodora – Steve Dorner – 1988 • Web e-‐mail
Ian Peter: h2p://www.nethistory.info/History%20of%20the%20Internet/email.html
5
E-‐mail usage, a partial look • In April, 2008 USA Today ar<cle cites ComScore Media Metrix figures for February, 2008: • MicrosoB webmail proper<es: 256.2 million users • Yahoo: 254.6 million users • Google: 91.6 million users • AOL webmail proper<es: 48.9 million users
h2p://www.email-‐marke<ng-‐reports.com/metrics/email-‐sta<s<cs.htm 6
8 e-‐mail statistics to bring up at a party 1. If email was a country, its 1.4 billion users would make it the largest in the
world. Bigger than China, bigger than the popula<ons of the USA and European Union combined.
2. 247 billion emails are sent each day. That's one email every 0.00000035 seconds.
3. In the <me it takes you to read this sentence, some 20 million emails entered cyberspace.
4. Every second, the world's email users produce messages equivalent in size to over 16,000 copies of the Complete Works of Shakespeare (assuming a 30KB average email size).
5. 13.4 billion: the number of direct marke<ng dollars forecast to go on email in the US in 2009.
6. $583 billion: the return from that investment if you use DMA figures on email marke<ng ROI. That's four Bmes the market value of MicrosoB.
7. 181: the number of marke<ng emails it would take to produce enough revenue to buy one share in MicrosoB.
8. 83,689,738,832,367: the number of marke<ng emails it would take to produce enough revenue to pay the US Na<onal Debt.
Mark Brownlow: h2p://www.email-‐marke<ng-‐reports.com/iland/2009/08/8-‐email-‐sta<s<cs-‐to-‐use-‐at-‐par<es.html
7
E-‐mail misuse: SPAM – 24 hrs 2010
8
E-‐mail misuse: SPAM – 24 hrs 2011
9
E-‐mail misuse: SPAM – 1 week 2010
10
E-‐mail misuse: SPAM – 1 week 2011
11
24 Hours (Now)
12
1 Week (Now)
13
Evidence can we get from e-‐mails? • Dates/Times • Sender/Receiver • E-‐mail servers • Culpatory evidence • Example case • Purchased items, communica<on etc.
• Words used • Mood • Personality traits • Authorship a2ribu<on • IP addresses 14
E-‐mail Forensics • Step 1 – Get the e-‐mail header! • Get the most accurate <meline possible • Be sure the original e-‐mail is not deleted • Different e-‐mail clients/web clients have different ways of repor<ng the headers. Learn those ways and familiarize yourself with them.
15
What is the e-‐mail header? • Informa<on that travels with every e-‐mail • Contains details about: • The sender • Route • Recipient
• It is like a flight <cket: • Who booked it (who sent the email) • Departure informa<on (when the email was sent) • Route (from where it was sent and how did it arrive to you) • Arrival details (who is the receiver and when it was received).
• You can book a <cket with fake iden<ty • Sender can par<ally fake sender details pretending that the email was sent from a different account (common for spammers or viruses).
h2p://www.emailaddressmanager.com/<ps/header.html
16
Rogers (2006)
17
18 Rogers (2006)
Rogers (2006)
19
Rogers (2006)
20
Rogers (2006)
21
Rogers (2006)
22
Rogers (2006)
23
Rogers (2006)
24
Rogers (2006)
25
Right Click
Rogers (2006)
26
Rogers (2006)
27
Viewing e-‐mail headers • MicrosoB Outlook 98, 2000, 2002, 2003 • Double-‐click on the message to open it in a separate window. • Click on View and then Op#ons on the drop-‐down menu at the top of the window.
• Look for the sec<on <tled INTERNET HEADERS near the bo2om of the Op#ons window.
• You can highlight the text within the INTERNET HEADERS sec<on to copy it to a new message if you need to send these headers to someone.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 28
Viewing e-‐mail headers • MicrosoB Outlook Express 5 & 6 • Right-‐click on the message and select ProperBes. • Select the Details tab. • You should see a sec<on <tled Internet Headers for this message. • You can highlight the text within the Internet Headers sec<on to copy it to a new message if you need to send these headers to someone.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 29
Viewing e-‐mail headers • Pegasus Mail Clients • Double-‐click on the message to open it in a separate window. • Hit the backspace key or type Ctrl-‐h on your keyboard to show the full headers.
• If you want to forward these headers to someone, hit the F key aBer comple<ng step 2.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 30
Viewing e-‐mail headers • Mozilla Thunderbird • Double-‐click the e-‐mail you want to view the headers on. • Click on the View drop-‐down menu and select Headers and then select All.
• This will show the headers for any message you view.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 31
Viewing e-‐mail headers • Mail for Mac OS X • ABer you open the Mail app, click the on the Mail drop-‐down menu and select Preferences.
• Click on the Viewing icon. • Click on the arrow on the Show header detail and select All. • You will now see the full headers of each message you view.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 32
Viewing e-‐mail headers • Eudora Mail Clients • Double-‐click on the message to open it in a separate window. • Click on the bu2on labeled BLAH BLAH BLAH at the top of the window. This will show the message headers.
• You can then highlight and copy the headers into a new message for forwarding to someone.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 33
Viewing e-‐mail headers • Hotmail • Once you are logged in, click on OpBons • Click on Mail. • Click on Mail Display SeSngs. • Change the Message Headers sec<on to Advanced. • Click OK. • Now when you read an e-‐mail, it should show you the full message headers.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 34
Viewing e-‐mail headers • Yahoo! Mail • Once you are logged in, click on Mail OpBons. • Click on General Preferences. • Under the Messages sec<on, select Show all headers on incoming messages for the Headers op<on.
• Click Save. • You should now see the full headers of every message you view.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 35
Viewing e-‐mail headers • Gmail • While viewing a message, click on the More opBons arrow in the upper-‐right of your message pane.
• Click on Show original. • This will display the headers for that message in a new window.
h2ps://hdc.tamu.edu/reference/documenta<on/index.php?sec<on_id=589 36
Comprehensive list acquiring e-‐ mail headers • Spamcop thank you! • h2p://www.spamcop.net/fom-‐serve/cache/19.html
37
Understanding e-‐mail headers • Tip 1: Read from the bo2om up. • Ex. E-‐mail sent from [email protected] to [email protected]
Delivered-‐To: [email protected] Received: by 10.36.81.3 with SMTP id e3cs239nzb; Tue, 29 Mar 2005 15:11:47 -‐0800 (PST) Return-‐Path: Received: from mail.emailprovider.com (mail.emailprovider.com [111.111.11.111]) by mx.gmail.com with SMTP id h19si826631rnb. 2005.03.29.15.11.46; Tue, 29 Mar 2005 15:11:47 -‐0800 (PST) Message-‐ID: <[email protected]> Received: from [11.11.111.111] by mail.emailprovider.com via HTTP; Tue, 29 Mar 2005 15:11:45 PST Date: Tue, 29 Mar 2005 15:11:45 -‐0800 (PST) From: Mr Jones Subject: Hello To: Mr Smith
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
38
Understanding e-‐mail headers • Headers are added 3 <mes in prior example: 1. When Mr. Jones composes the email Date: Tue, 29 Mar 2005 15:11:45 -‐0800 (PST) From: Mr Jones Subject: Hello To: Mr Smith
2. When the email is sent through the servers of Mr. Jones' email provider, mail.emailprovider.com
Message-‐ID: <[email protected]> Received: from [11.11.111.111] by mail.emailprovider.com via HTTP; Tue, 29 Mar 2005 15:11:45 PST
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
39
Understanding e-‐mail headers 3. When the message transfers from Mr. Jones' email provider to Mr. Smith's Gmail address:
Delivered-‐To: [email protected] Received: by 10.36.81.3 with SMTP id e3cs239nzb;Tue, 29 Mar 2005 15:11:47 -‐0800 (PST) Return-‐Path: [email protected] Received: from mail.emailprovider.com (mail.emailprovider.com [111.111.11.111]) by mx.gmail.com with SMTP id h19si826631rnb; Tue, 29 Mar 2005 15:11:47 -‐0800 (PST)
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
40
Understanding e-‐mail headers Bottom-‐Up • Sec<on 1: Date: Tue, 29 Mar 2005 15:11:45 -‐0800 (PST) From: Mr Jones Subject: Hello To: Mr Smith
The date, sender, subject, and des#na#on -‐-‐ Mr. Jones entered this informa#on (except for the date) when he composed the email.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
41
Understanding e-‐mail headers Bottom-‐Up • Sec<on 2: Received: from [11.11.111.111] by mail.emailprovider.com via HTTP; Tue, 29 Mar 2005 15:11:45 PST
Mr. Jones used an email composi#on program to write the message, and it was then received by the email servers of mail.emailprovider.com.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
42
Understanding e-‐mail headers Bottom-‐Up • Sec<on 3: Message-‐ID: [email protected] A unique number assigned by mail.emailprovider.com to iden#fy the message.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
Does this mean anything? ….
43
Understanding e-‐mail headers Bottom-‐Up • Sec<on 4: Received: from mail.emailprovider.com (mail.emailprovider.com [111.111.11.111]) by mx.gmail.com with SMTP id h19si826631rnb. 2005.03.29.15.11.46; Tue, 29 Mar 2005 15:11:47 -‐0800 (PST)
The message was received from mail.emailprovider.com, by a Gmail server on March 29, 2005 at approximately 3 pm.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
44
Understanding e-‐mail headers Bottom-‐Up • Sec<on 5: Return-‐Path:
The address from which the message was sent.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
45
Understanding e-‐mail headers Bottom-‐Up • Sec<on 6: Received: by 10.36.81.3 with SMTP id e3cs239nzb; Tue, 29 Mar 2005 15:11:47 -‐0800 (PST)
The #me the message reached Gmail's servers.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
46
Understanding e-‐mail headers Bottom-‐Up • Sec<on 7
Delivered-‐To: [email protected] The email address the message will be delivered to.
h2p://mail.google.com/support/bin/answer.py? hl=en&answer=29436
47
Message IDs demystiUied • 2008 Research by Satheesaan Pasupatheeswaran shows interes<ng results.
• Sendmail Message IDs
Pasupatheeswaran (2008) 48
Message IDs demystiUied • $t • $t macro is a current UTC date and <me. This is forma2ed in yyyymmddhhmm. It consists of 12decimal values.
• In the above e.g. the $t part is 200808131227. If it is decoded the final results will be 2008-‐08-‐13 12:27. That means the email is handed over to delivery or delivered at 12:27 on 13-‐08-‐2008 UTC (Sendmail, 2007).
Pasupatheeswaran (2008) 49
Message IDs demystiUied • $i is referred as a queue id. It is generated with a special algorithm. Queue id has three different formats with respect to sendmail versions.
• Queue id versions are categorized as ‘before V8.6’, ‘star<ng with V8.6’ and ‘star<ng with V8.10’. Format of queue-‐id with respect to sendmail versions are given below (Costales et al., 2007). • Before V8.6 AApid • From V8.6 hourAApid • From V8.10 YMDhmsSEQpid
Pasupatheeswaran (2008) 50
Message IDs demystiUied • Sendmail V8.14
Pasupatheeswaran (2008) 51
Issues related to message IDs • No standard algorithm (RFC2822) says every message should have a unique ID but does not say how.
• Open source vs closed source e-‐mail • Iden<fying source MTA (Mail Transfer Agent) • Versions • Sendmail has the message ID changed thrice!
• Host <me • MTA must be synched with a reliable <me reference
• Spoofed message Ids • Headers without message-‐ids • Interna<onal coopera<on • E-‐mail servers may be located in other countries!
(Pasupatheeswaran, 2008) 52
Determining the Source
53
54
Received: from macsmtp.zu.ac.ae (macsmtp.zu.ac.ae [195.229.146.130]) by mx.google.com with ESMTP id 10si6828873yxe.4.2010.02.07.04.54.35; Sun, 07 Feb 2010 04:54:36 -‐0800 (PST)
55
195.229.146.130
56
•
57
Nslookup
Now you can verify it against the header informaBon! 58
Trace back (tracert)
59
Visual trace back
60
Challenges to think about • Remailers
Rogers (2006) 61
Challenges to think about Remailer Headers
x-mimeole: Produced By Microsoft Exchange V6.5 Received: from 1061exfe03.adpc.purdue.edu ([128.210.63.225]) by exchange.purdue.edu with Microsoft SMTPSVC(6.0.3790.1830);
Fri, 27 Oct 2006 17:21:22 -0400 MIME-Version: 1.0 Content-Type: text/html;
charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Received: from mailhub179.itcs.purdue.edu ([128.210.5.179]) by 1061exfe03.adpc.purdue.edu with Microsoft
SMTPSVC(6.0.3790.211); Fri, 27 Oct 2006 17:21:51 -0400 Received: from mailhub245.itcs.purdue.edu (mailhub245.itcs.purdue.edu [128.210.5.245]) by mailhub179.itcs.purdue.edu
(8.13.7/8.13.7/spamscan) with ESMTP id k9RLLMJP026592 for <[email protected]>; Fri, 27 Oct 2006 17:21:22 -0400 Received: from mout.perfora.net (mout.perfora.net [217.160.230.41]) by mailhub245.itcs.purdue.edu (8.13.7/8.13.7/external-
smtp) with ESMTP id k9RLLLMP010217 for <[email protected]>; Fri, 27 Oct 2006 17:21:22 -0400 Received: from [82.165.253.19] (helo=localhost) by mrelay.perfora.net (node=mrelayus0) with ESMTP (Nemesis), id
0MKoyl-1GdZ8i2pbl-0004Ug; Fri, 27 Oct 2006 17:21:21 -0400 Return-Path: <[email protected]> x-originalarrivaltime: 27 Oct 2006 21:21:51.0517 (UTC) FILETIME=[EB42A4D0:01C6FA0D] X-PMX-Version: 5.1.2.240295 X-PerlMx-Virus-Scanned: Yes X-PerlMx-Spam: Gauge=IIIIIII, Probability=7%, Report='NO_REAL_NAME 0, __CT 0, __CTE 0, __CTYPE_CHARSET_QUOTED 0,
__CT_TEXT_PLAIN 0, __HAS_MSGID 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __SANE_MSGID 0' Content-class: urn:content-classes:message Subject: Hidden Date: Fri, 27 Oct 2006 17:21:20 -0400 Message-ID: <[email protected]> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Hidden Thread-Index: Acb6DdoeGLplmXeaTbWoQU1Ff7PNbQ== From: <[email protected]> To: "Rogers, Marcus K" <[email protected]>
Rogers (2006) 62
Anonymizers & Encrypted eMail • Hushmail.com very popular • Easy encryp<on • Free account set up • Not really anonymous • Source IP address crea<ng the account is logged! • But …..
Rogers (2006) 63
SpooUing • The header can have spoofed informa<on • The SMTP protocol does not require any authen<ca<on • Spoofed default return address
• Trace back is a way of determining if the header has been spoofed
• Very manual process
Rogers (2006) 64
Some last words…
Source: Anatomy Of A Hack: The Rise And Fall Of Your Network By Steve Riley, Jesper M. Johansson
Rogers (2006)
65
In summary • Email is an important source of forensic informa<on • The full header informa<on is required • Source can be spoofed • Time zones and offsets are important • Trace back is cri<cal!
Rogers (2006) 66
References • Lecture notes: Marcus Rogers (2006) • SpamCop h2p://www.spamcop.net/fom-‐serve/cache/19.html • h2p://mail.google.com/support/bin/answer.py?hl=en&answer=29436 • h2p://igneous.scis.ecu.edu.au/proceedings/2008/forensics/ Satheesaan%20Email%20Message%20ID.pdf
• h2ps://hdc.tamu.edu/reference/documenta<on/index.php? sec<on_id=589
• Ian Peter: h2p://www.nethistory.info/History%20of%20the%20Internet/ email.html
• h2p://www.emailaddressmanager.com/<ps/header.html • h2p://www.email-‐marke<ng-‐reports.com/metrics/email-‐sta<s<cs.htm
67
Network Forensics - Lecture 08.pdf
Network Forensics By: Dr. Baggili ©
1
Defini8on • What is it?
• Network forensics deals with the capture, recording or analysis of network events in order to discover eviden8al informa8on about the source of security aDacks in a court of law. (Kissat & Miyomoto, 2006).
2
Goals and func8ons • Provide sufficient, authen8c, complete and law abiding evidence to prosecute a cyber criminal.
• Detect intruder aDacks using automated tools and monitoring network logs manually
• Track, locate, and iden8fy the intruder and deny further access to the network
• Collect evidence for civil or criminal li8ga8on against the intruders
Bhadran VK (2009)
3
Where does it fit in? • Is there a problem with defining the field?
• Is it part of Cyber Forensics, Computer Forensics, Digital Forensics, Forensic Compu8ng? Has everything turned into a network? I’m confused… Are you?
4
Network Forensics Big Picture
Informa8on Assurance
Incident Response (Cyber Forensics)
Network Forensics
Web forensics?
Honeypots & Honeynets
Log analysis
Packet capture & reconstruc8on
Network imaging
Email forensics
Vola8le memory?
Localiza8on and tracking
Computer Forensics
5
A word on the big picture • Defini8ons keep changing • No common body of knowledge on the subject • No accepted and published ontological model for network forensics (Great research project idea!!)
6
Network Forensics VS Computer Forensics • You thought computer forensic data was vola8le!
• What about network data? • Computer forensics deals mostly with “dead” systems • Network forensics deal with live systems! • Network forensics focuses on network data, ports, and deals with numerous network equipment
• Computer forensics focuses on the disk
7
Legal issues • Laws for gathering evidence are confusing • Logs may or may not be admissible • Perpetrator may or may not be prosecutable • It is important to know about:
• Local laws on computer-‐related crimes • Legal processes and how to build a criminal case
Bhadran VK (2009)
8
Network traffic • Network forensics can reveal who communicated with whom, when, how, and how oben.
• It can uncover the low-‐level addresses of the systems communica8ng, which inves8gators can use to trace an ac8on or conversa8on back to a physical device (backtracking).
• The en8re contents of e-‐mails, web surfing ac8vi8es and file transfers can be recovered and reconstructed to reveal the original transac8on.
• More importantly, the protocol data that surrounded each conversa8on is oben extremely valuable to the inves8gator, and this data can only be acquired from network-‐based devices.
• The payload inside the packet at the highest layer may end up on disc, but the envelope that got it there is only captured in the network traffic.
Bhadran VK (2009)
9
Network forensic procedures • We need to follow a methodology!
• Iden8fica8on • Report incident (Virus, DOS aDack)
• Preserva8on • Preserve eviden8ary data like logs, policies, databases)
• Acquisi8on • Image data storage devices, Vola8le memory forensics (ports, processes, etc),Open ports and connec8ons, Log files
• Analysis • Storage devices • Network devices/logs • Suspect iden8fica8on
• Presenta8on • Timelines, documenta8on (tools used, suspect interview reports)
10
Today • Due to 8me constraints:
• We will dedicate most of our 8me talking about logs (fun stuff!) • We will touch on packet capture and reconstruc8on
11
Log analysis • If you were to encounter a network aDack for instance, as system administrator what would you do? • Examine the logs! • What if they don’t exist?
• Then you are not a good system administrator right?
12
What is a log? • Generic or applica8on specific file that records noteworthy events.
13
Log file significance • Logs are the primary record keepers of system and network ac8vity.
• Basis for fast recovery when a service is modified illegally (system messages).
• Basis for tracing the break-‐in route of a system intruder (Secure Log)
RCCF (2010)
14
Simple situa8on – log headache?
Corporate Network
The Internet
ADack PC
Firewall IDS/IPS
Web Server
Database Server
15
A word on dates/8mes • Think about it – if the dates/8mes on all the servers were not synchronized… or if they were wrong..
• The trail of the dates/8mes will not make sense • Synchronize dates/8mes on servers/network devices, or ensure that they are logged with the proper dates and 8mes
16
What types of logs are there? • FTP server logs • Intrusion Detec8on System (IDS) logs • Intrusion Protec8on System (IPS) logs • E-‐mail server logs • Router logs • Firewall logs • DHCP logs • HTTP logs • Event logs (windows) • Virus/Malware scanner logs
17
Where are logs stored? • Can be stored on the device or other devices • Can be centralized using log servers • In memory?
Corporate Network
The Internet
ADack PC
Firewall IDS/ IPS
Web Server
Database Server
Log Server
18
Pros and Cons of log servers • Pros
• Easy management • Aids in crea8ng a workflow for managing corporate networks
• Cons • If the aDacker gains access to the log server, and the system admin did not create a fault tolerant system, then the aDacker can erase the logs!
19
Data stored in log files • The kind of data stored in log files could vary • For example
• Connec8ons made • Connec8on aDempts • Authen8ca8on aDempts • Shutdowns/restarts • Intrusion detec8on • Sobware installed • Configura8on changes • Updates
20
Log file types • Is there really one standard type of logs?
• Is this a challenge? (you bet!) • This is a cri8cal part of the inves8ga8on, is iden8fying what the log files mean
• Many logs are stored in ASCII • Some logs are stored in binary, or other formats
21
Windows logs • Security logs
• Logs events such as valid and invalid logon aDempts, as well as events related to resource use such as crea8ng, opening, or dele8ng files or other objects.
• Applica8on logs • The applica8on log contains events logged by applica8ons or programs.
• System logs • The system log contains events logged by system components.
RCCF (2010)
22
Windows logs cont. • System Log: Startup and shutdown messages, system component data, cri8cal services
• Security Log: Windows audi8ng system data only, including user & host auth, share access, prin8ng, other
• Applica8on Log: Nearly everything else
RCCF (2010)
23
Important event logs • Local logon a)empt failures
• Event IDs 529, 530, 531, 532, 533, 534, and 537 • Account Misuse
• Events IDs 530, 531, 532, and 533 • Account Lockouts
• Event IDs 539 • Domain logon a)empt failures
• Event IDs 675 and 677 • Crea8on of a user account.
• Event IDs 624 and 626 • User account password changed
• Event IDs 627 and 628
RCCF (2010)
24
Important event logs User account status changed An aDacker may aDempt to cover their tracks by disabling or dele8ng the account used during an aDack. All occurrences of Event IDs 629 and 630 should be inves8gated to ensure that these are authorized Transac8ons. Look for occurrences of Event ID 626 followed by Event ID 629 a short 8me later. This can indicate that a disabled account was enabled, used, and then disabled again.
RCCF (2010)
25
Important event logs • Modifica8on of Security Groups.
• Global group membership modifica8ons • Event IDs 632 and 633
• Domain local group membership modifica8ons • Event IDs 636 and 637
• Modifica8on of Security Log • Event IDs 612 and 517: to determine which user modified the audit policy All occurrences of Event ID 517 should be compared to a physical log indica8ng all 8mes that the security log was cleared.
RCCF (2010)
26
Important event logs • Policy Change
• Event ID 608: User right assigned • Event ID 609: User right removed
RCCF (2010)
27
Terminal services Terminal Services a)acks Terminal Services sessions can be leb in a connected state that allows processes to con8nue running aber the session is ended. Event ID 683 indicates when a user does not log out from the Terminal Services session, and Event ID 682 indicates when a connec8on to a previously disconnected session has occurred.
RCCF (2010)
28
IDS logs • Think about what an IDS does
• Generates an Alert if something is wrong • May capture some network traffic for post-‐analysis aber the alert
• When an IDS is included in an inves8ga8on • Find out as much informa8on from the system admin • Alerts may be sent to IT personnel
• They may be located in more than one place
• Get help/Interview IT personnel explaining the logs
Anson & Bunting (2007)
29
Snort IDS alert • Sample Snort Alert Log
Date: 11/25 16:27:09 Name: SNMP request tcp Priority: 2 Type: ADempted Informa8on Leak IP Info: 24.55.75.192:4482 -‐> 12.56.86.71:161 Refs: hDp://cve.mitre.org/cgi-‐bin/cvename.cgi?name=2002-‐0013
30
Firewall logs • The primary purpose of firewalls is to regulate network connec8ons • By configuring a list of acceptable and/or unacceptable connec8on parameters
• Connec8on aDempts which do not meet the allowed rules are dropped
• Firewall logs show which connec8ons were accepted/rejected
Anson & Bunting (2007)
31
Windows Firewall log #Version: 1.5 #Software: Microsoft Windows Firewall #Time Format: Local #Fields: date time action protocol src-ipdst-ipsrc-port
dst-port size tcpflagstcpsyntcpacktcpwinicmptypeicmpcodeinfo path
2009-10-23 14:12:49 DROP UDP 192.168.55.100 192.168.55.255 138 138 243 -------RECEIVE
2009-10-23 14:12:50 DROP UDP 192.168.55.100 192.168.55.255 138 138 229 -------RECEIVE
2009-10-23 14:12:51 DROP UDP 192.168.55.102 192.168.55.255 137 137 78 -------RECEIVE 32
HTTP logs • Web servers typically have connec8vity logging features
• Every file requested is recorded on a separate line in the log • A web page usually consists of mul8ple files, so logs can be large and tedious
• Logs can be used to track the number of users, requests, links from other sites etc.
• Most are in ASCII • Most are in W3C extended log format (hDp://www.w3.org/TR/ WD-‐logfile.html)
• HTTP logs contain a wealth of inves8ga8ve informa8on
Anson & Bunting (2007)
33
IIS log file #Sobware: Microsob Internet Informa8on Services 5.0
#Version: 1.0 #Date: 2007-‐04-‐16 00:13:01 #Fields: date 8me c-‐ipcs-‐username s-‐ips-‐port cs-‐ method cs-‐uri-‐stem cs-‐uri-‐query sc-‐status cs(User-‐Agent)
2010-‐03-‐17 00:12:01 201.29.243.158 -‐72.149.164.82 80 GET /Abe.jpg -‐200 Mozilla/ 4.0+(compa8ble;+MSIE+6.0;+Windows+NT +5.1;+SV1) 34
Field descrip8ons FIELDNAME DESCRIPTION date Date on which the activity occurred time Time at which the activity occurred, expressed in UTC (GMT) c-ip IP address of client making the request cs-username Username of authenticated user who accessed the server. Anonymous users are annotated by a hyphen s-sitename Internet service name & instance number that was serving the request s-computername Name of the server on which the log file entry was generated s-ip IP address of the server on which the log file was generated s-port Server port number that is configured for the service cs-method Requested action, most often GET method cs-uri-stem Target of the action (default.htm, index.htm, etc) cs-uri-query Query, if any, the client was requesting
Anson & Bunting (2007)
35
Field descrip8ons cont. FIELDNAME DESCRIPTION sc-status HTTP status code sc-win32-status Windows status code sc-bytes Number of bytes that the server sent to client cs-bytes Number of bytes that the server received from the client time-taken Length of time the requested action took, expressed in milliseconds cs-version Protocol version (HTTP or FTP) that the client used cs-host Host header name, if any cs(User-Agent) Browser type used by client cs(Cookie) Content of cookie (sent or received), if any cs(Referrer) Site last visited by user. This site provided a link to this current server. sc-substatus Substatus error code
Anson & Bunting (2007)
36
HTTP status codes • Part of the protocol is the status code • The code indicates whether the requests were made successfully or not
• It is important to understand these status codes because they are typically in the log files
• Explana8on of status codes: hDp://www.addedbytes.com/ar8cles/hDp-‐status-‐codes-‐explained/
Anson & Bunting (2007)
37
HTTP Logs-‐ General status codes
STATUS CODE DESCRIPTION 1xx Informational 2xx Successes 3xx Redirection 4xx Client Errors 5xx Server Errors
Anson & Bunting (2007)
38
HTTP logs -‐ Successes STATUSCODE DESCRIPTION 2xx Successes 200 OK 201 Created 202 Accepted 203 Non-authoritative information 204 No content 205 Reset content 206 Partial content 207 Multi-status -used with XML responses
when a number of actions could have been requested. Details of individual statuses are found in the message body Anson & Bunting (2007)
39
HTTP logs -‐ Redirec8on STATUSCODE DESCRIPTION 3xx Redirection 300 Multiple choices 301 Moved permanently 302 Moved temporarily (HTTP/1.0) or
Found (HTTP/1.1) 303 See other (HTTP/1.1) 304 Not modified 305 Use Proxy 306 No longer in use (formerly used for
switch proxy)
Anson & Bunting (2007)
40
HTTP logs – Client errors STATUSCODE DESCRIPTION 4xx Client Errors 400 Bad request 401 Unauthorized (its use is similar to 403,
but 401 is specifically used when authentication is possible
and has failed or was not provided by client) 402 Payment required (not really used) 403 Forbidden 404 Not found 405 Method not allowed 406 Not acceptable 407 Proxy authentication required 408 Request timeout Anson & Bunting (2007)
41
HTTP Logs -‐ Conflicts STATUSCODE DESCRIPTION 409 Conflict 410 Gone 411 Length required 412 Precondition failed 413 Requested entity is too large 414 Requested URI is too long 415 Unsupported media type 416 Requested range is not
satisfiable 417 Expectation failed 449 Retry with
Anson & Bunting (2007)
42
HTTP Logs – Server errors STATUSCODE DESCRIPTION 5xx Server Errors 500 Internal server error 501 Not implemented 502 Bad gateway 503 Service unavailable 504 Gateway timeout 505 HTTP version is not supported 509 Bandwidth limit exceeded
Anson & Bunting (2007)
43
FTP logs • FTP servers typically create logs • They are usually in ASCII format • They are usually in the W3C extended log format ( hDp://www.w3.org/TR/WD-‐logfile.html)
• Have status codes similar to HTTP
Anson & Bunting (2007)
44
Sample FTP log #Sobware: Microsob Internet Informa8on Services 5.0 #Version: 1.0 #Date: 2008-‐03-‐15 02:43:10 #Fields: 8me c-‐ipcs-‐method cs-‐uri-‐stem sc-‐status 02:43:10 192.168.1.32[11]USER Administrator 331 02:43:10 192.168.1.10 [11]PASS -‐230 02:44:11 192.168.1.10 [11]MKD malaf 257 02:44:12 192.168.1.10 [11]MKD bob 257 02:44:14 192.168.1.10 [11]MKD Party 257 02:43:17 192.168.1.10 [11]created index.htm 226 45
FTP logs – General status codes STATUSCODE DESCRIPTION 1xx Posi8ve Preliminary Replies 2xx Posi8ve Comple8on Replies 3xx Posi8ve Intermediate Replies 4xx Transient Nega8ve Comple8on
Replies 5xx Permanent Nega8ve Comple8on
Replies
Anson & Bunting (2007)
46
FTP logs – Posi8ve comple8on replies STATUSCODE DESCRIPTION 2xx Posi8ve Comple8on Replies 202 Command not implemented—superfluous at this site 211 System status or system help reply 212 Directory status 213 File status 214 Help message 215 NAME system type, where NAME is an official system name from the list in the Assigned Numbers document
220 Service ready for new user 221 Service closing control connec8on. Logged out if appropriate 225 Data connec8on open—no transfer in progress
Anson & Bunting (2007)
47
FTP logs – Posi8ve comple8on replies STATUSCODE DESCRIPTION 226 Closing data connec8on. Requested file ac8on successful (example,
file transfer, and so on). 227 Entering passive mode 230 User logged in—proceed 250 Requested file ac8on OK—completed 257 PATHNAME created 226 Closing data connec8on. Requested file ac8on successful (example,
file transfer, and so on). 227 Entering passive mode 230 User logged in—proceed 250 Requested file ac8on OK—completed 257 PATHNAME created
Anson & Bunting (2007)
48
FTP logs – Posi8ve intermediate replies
STATUSCODE DESCRIPTION 3xx Positive Intermediate Replies 331 Username okay, need password 332 Need account for login 350 Requested file action pending
further information
Anson & Bunting (2007)
49
FTP logs – Transient nega8ve comple8on
STATUSCODE DESCRIPTION 4xx Transient Negative Completion
Replies 421 Service not available—closing control
connection 425 Can’t open data connection 426 Connection closed—transfer aborted 450 Requested file action not taken—File
unavailable 451 Requested action aborted—local
error in processing 452 Requested action not taken -
insufficient storage space in system Anson & Bunting (2007)
50
DHCP logs • DHCP used to assign variable IPS to clients • DHCP logs are important because one can
• Inves8gate what computer was assigned to an IP address • To learn more about DHCP logs, you can visit: hDp://technet.microsob.com/en-‐us/library/cc776384(WS. 10).aspx
51
Log handling and management • Always back up logs
• Search logs for suspicious behavior • E.g., Logins from outside the domain Failed login aDempts
• Log everything you need, but not what you do not need • Rotate log files at intervals appropriate for your analysis and archiving requirements
• Write logs to a convenient, dis8nct, ample and secure loca8on
RCCF (2010)
52
Summary • Logs can be proprietary • ASCII is popular, but binary also exists • W3C extended format is popular • It is important to talk to system administrators to understand how they are logging, and if they are logging
• Logs can be tedious.. • Date and Time synchroniza8on are cri8cal in log files • Centralizing logs has pros and cons
53
Web forensics Web forensics deals with gathering cri6cal informa6on related to a crime by exploring the browsing history of a person, the number of 6mes a website has been visited, the dura6on of each visit, the files that have been uploaded and downloaded from the visited website, the cookies setup as part of the visit and other cri6cal informa6on (Natajan, Allam, Moore, 2009)
• Analysis of remnants of visited websites on a disk. • Depends on the browsers being used
• IE (Index.dat) • Mozilla (History.dat)
• Popular free tools • Mandiant web historian • Index.dat analyzer 54
Packet capture & reconstruc8on (PC&R) • Defini8on
• Packet sniffer: A sniffer is sobware that collects traffic flowing into and out of a computer aDached to a network
• Popular tools • Ethereal/Wireshark
55
PC&R – Challenges • Data Capture:
• (a) Where should the data be captured? • (b) How much data should be captured? • (c) How do we insure the integrity of the collected data?
• Detec6on Efficiency: The system should detect aMacks efficiently in order to trigger the forensics process. Therefore, it should accommodate for different detec8on approaches.
• Data Analysis: ANer collec6ng the data, the system has to correlate them in order to reconstruct an aDacker’s ac8ons (Almulhem & Traore, 2005).
56
PC&R – Challenges • AMacker Profiling: The system has to maintain informa6on about the aMacker. For instance, it can iden8fy the aDacker’s opera8ng system through passive OS fingerprin8ng.
• Privacy: Depending on the applica6on domain, privacy issues can be a major concern.
• Data as Legal Evidences: For the collected data to qualify as evidences in a court of law, they have to be correctly collected and preserved in order to pass admissibility tests (Almulhem & Traore, 2005). 57
PC&R • Capturing network traffic can be done in two major ways
• Sobware captures (Wireshark, TCPDump) • Hardware capture devices
• Whether the capture is hardware/sobware based, the loca8on of the capturing technology is of cri8cal importance
• PC&R is more feasible in organiza8ons – but even then, can you imagine how much data it would take?
58
PC&R • One way of decreasing data is by capturing only required protocols • Packet filtering
59
PC&R challenges • Some issues that might impact authen8city/integrity of network forensics • TCP relaying/proxying • Onion rou8ng • Anonymous remailing • Web anonymizers • IP spoofing • Email spoofing • Compromised third party machines
• Session hijacking • DNS cache poisoning • Other man-‐in-‐the-‐middle aDacks (Nikkel, 2005)
60
The portable network evidence collector • A PNEC was created by Bruce Nikkel in 2006 • Device created carefully not to inject traffic into the captures • Runs Open BSD 3.8 • Now – many other capture devices on the market
61
Network Capture Device – Inves8gator Mode
Investigator mode involves an investigator capturing activity during an investigation or evidence collection of remote network services. These services may include remote ftp or web sites, peer-to-peer networks, NS/Whois data collection, etc. The PNFEC is inserted between the investigator's own workstation and the network, collecting all traffic generated by the investigator.
Nikkel (2006) 62
Network Capture Device – Server Mode
Server mode involves capturing activity during an attack, intrusion, or abuse directed against a single server or other network node. The PNFEC is inserted between the server being misused and the network. All traffic coming to/from the server can be collected.
Nikkel (2006) 63
Network Capture Device – User Mode
User mode involves capturing network activity generated by a single end user or end user machine. The PNFEC is inserted between the end user/machine and the network, and collects evidence of abuse, criminal activity or policy violation originating from the user/machine. In such cases, the PNFEC can be discreetly deployed in a wiring closet at the Ethernet hub/switch or patch panel.
Nikkel (2006) 64
Captured packets
65
Pcap file
66
Packets reconstructed
67
Packets reconstructed
68
Packet reconstruc8on tools • SilentRunner
• By Access Data • Live analysis • Live capture (graphical) • Reconstruc8on • EXPENSIVE
• NetWitness • Free for the most part • Capture • Reconstruc8on
• NetIntercept – Download trial version – Reconstruc8on – Capture with Wireshark – Import Pcap file
• Networkminer – Free!
• NeSA • Network Session Analyzer
69
E-‐mail forensics • I think we discussed this enough, don’t you think? J
70
Network imaging • We discussed this in the prerequisite class
• Network dd • Another tool created by a friend of mine at UCD (RAFT – Remote Acquisi8on Forensic Tool) by Mark Scanlon – ICDF2C 2009
• EnCase Enterprise Edi8on
71
Vola8le memory • We’ll talk about this next lecture. • New and exci8ng. • Some regard it as part of network forensics
72
Localiza8on and tracking • Paper to read by Al-‐Kuwari Wolthusen1, ICDF2C 2009 “A Survey of Forensic Localiza8on and Tracking Mechanisms in Short-‐Range and Cellular Networks”
73
References • K. Sisaat and D. Miyamoto, “Source Address Valida8on Support for Network
Forensics,”Proceedings of the 1st Joint Workshop on Informa6on Security, Sep 2006. • A. Almulhem and I. Traore, “Experience with engineering a network forensics system,”
Lecture Notes in Computer Science, vol. 3391, pp.62–71, Jan. 2005. • Nikkel, B. J. (2006). A portable network forensic evidence collector. Digital Inves8ga8on, 3(3),
127-‐135. • hDp://www.netwitness.com/ • hDp://www.accessdata.com/ • RAFT, Marc Scanlon and Mohand-‐Taher Kechadi, Interna8onal Conference on Digital
Forensics and Cyber Crime, 2009, Albany NY • A Survey of Forensic Localiza8on and Tracking Mechanisms in Short-‐Range and Cellular
Networks, Saif Al-‐Kuwari and Stephen D. Wolthusen, Interna8onal Conference on Digital Forensics and Cyber Crime, 2009, Albany, NY
• Nikkel, B.J. (2005), "Generalizing Sources of Live Network Evidence," Digital Inves6ga6on, 2(3): 193-‐200
• RCCF Presenta6on 2010, India • Mastering Windows Network Forensics and Inves8ga8on, Steve Anson & Steve Bun8ng, 2007 • Bhadran VK, 2009 – Introduc8on to Network Forensics Presenta8on • Comic image retrieved from hDp://www.atariarchives.org/deli/computer_networking1.jpg
74