Redpoll

50 %
50 %
Information about Redpoll

Published on March 11, 2009

Author: coderplay

Source: slideshare.net

Description

My Parallel Machine Learning Project

Redpoll A machine learning library based on hadoop Min Zhou (coderplay@gmail.com) CS Dept. Jinan University, Guangzhou

A machine learning library based on hadoop

Introduction What is redpoll? Who will use redpoll? Motivation Challenge from large-scale datasets More pratical when mining textual corpus Close to we chinese people Apache licensed

What is redpoll?

Who will use redpoll?

Motivation

Challenge from large-scale datasets

More pratical when mining textual corpus

Close to we chinese people

Apache licensed

Basic Principles ... Decomposition Mappers Reducer Assume that we have a set of m data points each of length n

Performance Bottlenecks Network bandwidth I/O speed Algorithm implementations Hadoop

Network bandwidth

I/O speed

Algorithm implementations

Hadoop

Current Works Vector Writable utils Distance Measure utils Naive Bayes Canopy K-means An Infrastructure for textual DM An example for mining Sogou news

Vector Writable utils

Distance Measure utils

Naive Bayes

Canopy

K-means

An Infrastructure for textual DM

An example for mining Sogou news

An example: Canopy Large, high dimensional datasets clustering Two different distance Two stages Computation saving Applying many domains EM, GAC, K-means

Large, high dimensional datasets clustering

Two different distance

Two stages

Computation saving

Applying many domains

EM, GAC, K-means

An example: Canopy cont'd CanopyDriver CanopyMapper Input <label, vector> output <“canopy“, center> CanopyReducer output <“canopy“, center> ClusterDriver & ClusterMapper assign each point to canopies

CanopyDriver

CanopyMapper

Input <label, vector>

output <“canopy“, center>

CanopyReducer

output <“canopy“, center>

ClusterDriver & ClusterMapper

assign each point to canopies

What's the Next? SVM(Support Vector Machine) Fast in training and prediction Optimal hyperplane Kernels Duality Decomposition Parallelize approach

SVM(Support Vector Machine)

Fast in training and prediction

Optimal hyperplane

Kernels

Duality

Decomposition

Parallelize approach

Algorithms under plan EM(Expectation Maximization) LSI(Latant Semantic Indexing) SVD (Singular Values Decomposition) PCA(Principal Components Analysis) PageRank KNN(k Nearest Neighbors) Linear Regression and so on ...

EM(Expectation Maximization)

LSI(Latant Semantic Indexing)

SVD (Singular Values Decomposition)

PCA(Principal Components Analysis)

PageRank

KNN(k Nearest Neighbors)

Linear Regression

and so on ...

Welcome to join us! Development Documentation Source code management Suggestion Any other things can help us

Development

Documentation

Source code management

Suggestion

Any other things can help us

http://code.google.com/p/redpoll Check it out!

Add a comment

Related presentations

Related pages

Common redpoll - Wikipedia, the free encyclopedia

The common redpoll (Acanthis flammea) is a species of bird in the finch family. It breeds somewhat further south than the Arctic redpoll, also in habitats ...
Read more

Redpoll - Wikipedia, the free encyclopedia

Redpolls; Common redpoll in Oulu, Finland: Scientific classification; Kingdom: Animalia: Phylum: Chordata: Class: Aves: Order: Passeriformes: Family ...
Read more

A BTO Garden BirdWatch factsheet

Redpoll and Redpolls. Contact us at: BTO Garden BirdWatch, The Nunnery, Thetford, Norfolk, IP24 2PU. Tel: 01842 750050. E-mail: gbw@bto.org
Read more

Common Redpoll, Identification, All About Birds - Cornell ...

Learn how to identify Common Redpoll, its life history, cool facts, sounds and calls, and watch videos. As energetic as their electric zapping call notes ...
Read more

The RSPB: Lesser redpoll

This tiny finch – only slightly bigger than a blue tit – is streaky and brown with patches of red. They like to hang upside down to feed in trees.
Read more

Hoary Redpoll, Identification, All About Birds - Cornell ...

Learn how to identify Hoary Redpoll, its life history, cool facts, sounds and calls, and watch videos. A small pale bird of the high Arctic, the Hoary ...
Read more

The RSPB: Mealy redpoll

The mealy redpoll is a small finch. It is larger and paler than the very similar lesser redpoll. It is streaky brown above and whitish below with black ...
Read more

Welcome - Red Poll Cattle Society

Welcome to the Red Poll Cattle Society. The Red Poll Cattle Society is a registered Charity in the U.K. and was founded in 1888 to encourage the ...
Read more

Lesser Redpoll: our ‘new’ garden finch | BTO - British ...

Lesser Redpolls are a terrific addition to any garden, bringing with them lots of activity and lively twittering. They are sociable birds, often travelling ...
Read more

Common Redpoll - BirdWeb

Common Redpoll habitat, behavior, diet, migration patterns, conservation status, and nesting.
Read more