Category Archives: Resource

Python Resource

 Python语言:

1、Python Language Essentials  《Python for Data Analysis》

2、廖雪峰python教程

Python函数式编程:从入门到走火入魔

Python工具及环境:

IPython Notebook: 交互计算新时代

Anaconda Scientific Python Distribution

WinPython

库与框架:

Beautiful Soup 4.2.0 文档

10 Minutes to pandas

数据分析:

零基础学习Python数据分析

Book:

Python基础教程

利用Python进行数据分析

集体智慧编程 (豆瓣)

这是一本非常好的入门书,书中的例子源码都是Python实现的,并且能帮你迅速熟悉Python相关的各种计算库

统计学习方法 (豆瓣)

这本书深入浅出地讲了和机器学习有关的一切数学基础知识,一整本的干货,没有废话,非常值得一读

Some Online Resources:

http://docs.python.org/tut/tut.html – Beginners

http://diveintopython3.ep.io/ – Intermediate

http://www.pythonchallenge.com/ – Expert Skills

http://docs.python.org/ – collection of all knowledge

Some more:

A Byte of Python.

Python 2.5 Quick Reference

Python Side bar

A Nice blog for beginners

Think Python: An Introduction to Software Design

Python Resource

优秀Python学习资源收集汇总(强烈推荐)

学习Python编程的11个资源

Hidden features of Python

怎么用最短时间高效而踏实地学习 Python

refer:http://stackoverflow.com/questions/70577/best-online-resource-to-learn-python

Machine Learning &Deep Learning Resource

基础:

什么是机器学习?
机器学习该怎么入门?
机器学习的八个步骤
神经网络:卷积神经网络
数据挖掘学习图谱
图解机器学习
深度学习概述:从感知机到深度网络
A gentle guide to machine learning
Conv Nets: A Modular Perspective
周剑铭 柳渝:机器与“学习”——寻找人工智能的幽灵
一天搞懂深度學習
机器学习自学指南
一文读懂 CNN、DNN、RNN 内部网络结构区别
何为机器学习特征选择的经典三刀?
A Guide to Deep Learning by  YN2

数学及算法基础:
机器学习(一) 简单的背景介绍、线性回归、梯度下降
机器学习中的数学(1)-回归(regression)、梯度下降(gradient descent)
线性判别分析(LDA), 主成分分析(PCA)
麻省理工公开课:线性代数
李航老师的《统计学习方法》

框架:

 最好的Python机器学习库
SciKit-Learn
Caffe
Torchnet(Facebook)
TensorFlow(Google)
deeplearning4j

应用:

Neural Network for Recognition of Handwritten Digits
MNIST  OCR
ImageNet
TensorFlow在图像识别中的应用
探索推荐引擎内部的秘密,第 1 部分: 推荐引擎初探
机器学习问题的十个实例

平台 :

大数据竞赛平台——Kaggle 入门

课程:

Machine Learning
Neural Networks for Machine Learning

资源汇总:
机器学习入门资源不完全汇总
DeepLearning.net
josephmisiti/awesome-machine-learning · GitHub 机器学习资源大全
《机器学习实践》源码和《机器学习-算法原理与编程实践》源码以及学习心得
Learn Machine Learning With These Six Great 
博客文章索引
参考文献和Deep Learning学习资源
李航《浅谈我对机器学习的理解》 机器学习与自然语言处理
机器学习(Machine Learning)&深度学习(Deep Learning)资料
DeepLearning tutorial(3)MLP多层感知机原理简介+代码详解
DeepLearning tutorial(4)CNN卷积神经网络原理简介+代码详解
python sample code of DL
Scipy Lecture Notes
scikit-learn: machine learning in Python
Keras中文文档
机器学习资源大全中文版
机器学习的最佳入门学习资源
机器学习(Machine Learning)&深度学习(Deep Learning)资料

职位技能及需求:

大数据职位所需的数据场技能

 

渗透测试资源

开源黑盒测试工具
一般测试
• OWASPWebScarab
• OWASP CAL9000: CAL9000 是一个基于浏览器的工具集合,它可以使得手动测试更加快速高效。它包含有一个XSS 攻击
库,字符编码器/解码器,HTTP 请求生成器和响应计算器,测试清单,自动攻击编辑器以及其它很多内容。
• OWASP PanteraWeb Assessment Studio Project
• SPIKE – http://www.immunitysec.com
• Paros – http://www.parosproxy.org
• Burp Proxy – http://www.portswigger.net
• Achilles Proxy – http://www.mavensecurity.com/achilles
• Odysseus Proxy – http://www.wastelands.gen.nz/odysseus/
• Webstretch Proxy – http://sourceforge.net/projects/webstretch
• Firefox LiveHTTPHeaders, Tamper Data and Developer Tools – http://www.mozdev.org
• Sensepost Wikto (Google cached fault-finding) – http://www.sensepost.com/research/wikto/index2.html
• Grendel-Scan – http://www.grendel-scan.com

特定漏洞测试

Flash测试

  • OWASP SWFIntruder – http://www.owasp.org/index.php/Category:SWFIntruder,

http://www.mindedsecurity.com/swfintruder.html

AJAX测试

  • OWASP Sprajax Project

SQL注入测试

  • OWASP SQLiX
  • Multiple DBMS SQL Injection tool – SQL Power Injector
  • MySQL Blind Injection Bruteforcing, Reversing.org – [sqlbftools]
  • Antonio Parata: Dump Files by SQL inference on Mysql – [SqlDumper]
  • Sqlninja: a SQL Server Injection & Takeover Tool – http://sqlninja.sourceforge.net
  • Bernardo Damele and Daniele Bellucci: sqlmap, a blind SQL injection tool – http://sqlmap.sourceforge.net
  • Absinthe 1.1 (formerly SQLSqueal) – http://www.0x90.org/releases/absinthe/
  • SQLInjector – http://www.databasesecurity.com/sql-injector.htm
  • bsqlbf-1.2-th – http://www.514.es

Oracle测试

  • TNS Listener tool (Perl) – http://www.jammed.com/%7Ejwa/hacks/security/tnscmd/tnscmd-doc.html
  • Toad for Oracle – http://www.quest.com/toad

SSL测试

  • Foundstone SSL Digger – http://www.foundstone.com/resources/proddesc/ssldigger.htm

暴力破解密码测试

  • THC Hydra – http://www.thc.org/thc-hydra/
  • John the Ripper – http://www.openwall.com/john/
  • Brutus – http://www.hoobie.net/brutus/
  • Medusa – http://www.foofus.net/~jmk/medusa/medusa.html

HTTP方法测试

  • NetCat – http://www.vulnwatch.org/netcat

缓冲区溢出测试

  • OllyDbg – http://www.ollydbg.de

o “一个基于Windows 的用于分析缓冲区溢出漏洞的调试器”

  • Spike – http://www.immunitysec.com/downloads/SPIKE2.9.tgz
  • 一个可用于探寻漏洞以及执行长度测试的漏洞检查框架
  • Brute Force Binary Tester (BFB) – http://bfbtester.sourceforge.net

o 一个主动的二进制检查器

  • Metasploit – http://www.metasploit.com/projects/Framework/

o 一个快速的攻击产生和测试框架

Fuzzing工具

  • WSFuzzer

Googling

  • Foundstone Sitedigger (Google cached fault-finding) – http://www.foundstone.com/resources/proddesc/sitedigger.htm

商业黑盒测试工具

  • Typhon – http://www.ngssoftware.com/products/internet-security/ngs-typhon.php
  • NGSSQuirreL – http://www.ngssoftware.com/products/database-security/
  • Watchfire AppScan – http://www.watchfire.com
  • Cenzic Hailstorm – http://www.cenzic.com/products_services/cenzic_hailstorm.php
  • SPI Dynamics WebInspect – http://www.spidynamics.com
  • Burp Intruder – http://portswigger.net/intruder
  • Acunetix Web Vulnerability Scanner – http://www.acunetix.com
  • ScanDo – http://www.kavado.com
  • WebSleuth – http://www.sandsprite.com
  • NT Objectives NTOSpider – http://www.ntobjectives.com/products/ntospider.php
  • Fortify Pen Testing Team Tool – http://www.fortifysoftware.com/products/tester
  • Sandsprite Web Sleuth – http://sandsprite.com/Sleuth/
  • MaxPatrol Security Scanner – http://www.maxpatrol.com
  • Ecyware GreenBlue Inspector – http://www.ecyware.com
  • Parasoft WebKing (more QA-type tool)

OWASP 测试指南v3.0

  • MatriXay – http://www.dbappsecurity.com
  • N-Stalker Web Application Security Scanner – http://www.nstalker.com

源代码分析工具—开源/免费软件

  • OWASP LAPSE
  • PMD – http://pmd.sourceforge.net/
  • FlawFinder – http://www.dwheeler.com/flawfinder
  • Microsoft’s FxCop
  • Splint – http://splint.org
  • Boon – http://www.cs.berkeley.edu/~daw/boon
  • Pscan – http://www.striker.ottawa.on.ca/~aland/pscan
  • FindBugs – http://findbugs.sourceforge.net

源代码分析工具—商业软件

  • Fortify – http://www.fortifysoftware.com
  • Ounce labs Prexis – http://www.ouncelabs.com
  • Veracode – http://www.veracode.com
  • GrammaTech – http://www.grammatech.com
  • ParaSoft – http://www.parasoft.com
  • ITS4 – http://www.cigital.com/its4
  • CodeWizard – http://www.parasoft.com/products/wizard
  • Armorize CodeSecure – http://www.armorize.com/product/
  • Checkmarx CxSuite – http://www.checkmarx.com

验收测试工具—开源

Servlet Container Resource

Java Servlet 技术简介

Servlet 工作原理解析

Tomcat 系统架构与设计模式,第 1 部分: 工作原理

Tomcat 系统架构与设计模式

Tomcat 设计模式分析

Jetty 的工作原理以及与 Tomcat 的比较

Unit Test Resources

Is Unit Testing worth the effort?

How to test a class that has private methods, fields or inner classes?

 

Every day in our office there is an exchange which goes something like this:

“Man, I just love unit tests, I’ve just been able to make a bunch of changes to the way something works, and then was able to confirm I hadn’t broken anything by running the test over it again…”

The details change daily, but the sentiment doesn’t. Unit tests and test-driven development (TDD) have so many hidden and personal benefits as well as the obvious ones that you just can’t really explain to somebody until they’re doing it themselves.

But, ignoring that, here’s my attempt!

  1. Unit Tests allows you to make big changes to code quickly. You know it works now because you’ve run the tests, when you make the changes you need to make, you need to get the tests working again. This saves hours.
  2. TDD helps you to realise when to stop coding. Your tests give you confidence that you’ve done enough for now and can stop tweaking and move on to the next thing.
  3. The tests and the code work together to achieve better code. Your code could be bad / buggy. Your TEST could be bad / buggy. In TDD you are banking on the chances of both being bad / buggy being low. Often it’s the test that needs fixing but that’s still a good outcome.
  4. TDD helps with coding constipation. When faced with a large and daunting piece of work ahead writing the tests will get you moving quickly.
  5. Unit Tests help you really understand the design of the code you are working on. Instead of writing code to do something, you are starting by outlining all the conditions you are subjecting the code to and what outputs you’d expect from that.
  6. Unit Tests give you instant visual feedback, we all like the feeling of all those green lights when we’ve done. It’s very satisfying. It’s also much easier to pick up where you left off after an interruption because you can see where you got to – that next red light that needs fixing.
  7. Contrary to popular belief unit testing does not mean writing twice as much code, or coding slower. It’s faster and more robust than coding without tests once you’ve got the hang of it. Test code itself is usually relatively trivial and doesn’t add a big overhead to what you’re doing. This is one you’ll only believe when you’re doing it 🙂
  8. I think it was Fowler who said: “Imperfect tests, run frequently, are much better than perfect tests that are never written at all”. I interpret this as giving me permission to write tests where I think they’ll be most useful even if the rest of my code coverage is woefully incomplete.
  9. Good unit tests can help document and define what something is supposed to do
  10. Unit tests help with code re-use. Migrate both your code and your tests to your new project. Tweak the code till the tests run again.

A lot of work I’m involved with doesn’t Unit Test well (web application user interactions etc.), but even so we’re all test infected in this shop, and happiest when we’ve got our tests tied down. I can’t recommend the approach highly enough.