How to Make a CURL Request Identicle to a Browser Request

It is possible to get the identical CURL request directly from the browser. Most of the modern browsers have it's own developer tool set. I will use Firebug for this.

1. Right click the browser and Click 'Inspect Element with Firebug'

2.  Click on Network tab

3. Enter url of the request and press Enter.

4. Write click on the required request and click 'Copy as cURL'

5. Identical CURL request command will be copied.

curl 'http://code-mix.blogspot.sg/' -H 'Host: code-mix.blogspot.sg' -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:45.0) Gecko/20100101 Firefox/45.0' -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' -H 'Accept-Language: en-US,en;q=0.5' --compressed -H 'Connection: keep-alive' -H 'If-Modified-Since: Thu, 14 Apr 2016 08:02:15 GMT' -H 'If-None-Match: "7788a232-d2d1-4c83-bc9d-b3d2bcd45409"'

view raw curl_request.sh hosted with ❤ by GitHub

Php Script to Download Your Facebook Albums

In facebook there is no option to download all the albums that you have created. Following steps will describe how you can use a php script to download all the albums to your local machine.

I have used facebook access token to authenticate and facebook graph API to retrieve album details.

1. You can get the script from following git-hub repository.
https://github.com/yasithacp/fb-albums-download-script

2. Then you need to get your facebook access token.

• Go to the facebook graph explorer.
• Log in using your facebook credentials.
• Click on the Get Token drop down and then Get Access Token.
• Select user_photos check-box and click on Get Access Token.
• Note down your access token.

3. Open up the script file and modify the following configuration section.

	define('ACCESS_KEY', 'xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx');
	define('API_HOST', 'https://graph.facebook.com/');
	define('VERSION', 'v2.3');
	define('FOLDER_PATH', '/Users/yasitha/facebook_albums/');

view raw fb-album-downloader.php hosted with ❤ by GitHub

• ACCESS_KEY: Access key retrieved in step 2.
• FOLDER_PATH: Local folder path that albums should download.

4. Obviously you should have php on your machine.

5. Execute the following command to run the script and download will start.

php download-facebook-albums.php

view raw fb-album-downloader-2 hosted with ❤ by GitHub

6. If you have large number of albums, script will take time to download all the albums. If your access token get expired repeat the step 1 and replace the script with your new access token and re-run the script. Download will resume.

Ruby script to use Azure Blob Storage

Azure Blob storage is a service for storing large amounts of unstructured data, such as text or binary data, that can be accessed from anywhere in the world via HTTP or HTTPS. You can use Blob storage to expose data publicly to the world, or to store application data privately.

This post will show you how to perform common scenarios using the Azure Blob service. The samples are written using the Ruby API. The scenarios covered include uploading, listing, downloading, and deleting blobs.

You can download final ruby script from here.

This post assumes you have already created a storage account and a container.

• Type "gem install azure" in the command window to install the gem and dependencies.

• Import installed package in to the script file.

require "azure"

view raw blobstorage1.rb hosted with ❤ by GitHub

• Setup global parameters.

	Azure.config.storage_account_name = "account"
	Azure.config.storage_access_key = "xxxxxxxxxxxxxxx+xxxxxxxxxxxxxxxx/xxxx+xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=="
	CONTAINER = "container"
	AZURE_BLOB_SERVICE = Azure::BlobService.new

view raw blobstorage2.rb hosted with ❤ by GitHub

• Uploading a Blob into a Container

	def upload(input_path, blob_name)
	content = File.open(input_path, "rb") { |file| file.read }
	blob = AZURE_BLOB_SERVICE.create_block_blob(CONTAINER,
	blob_name, content)
	puts blob.name + " uploaded succesfully.."
	end

view raw blobstorage3.rb hosted with ❤ by GitHub

• List the Blobs in a Container

	def list()
	containers = AZURE_BLOB_SERVICE.list_containers()
	containers.each do |container|
	blobs = AZURE_BLOB_SERVICE.list_blobs(container.name)
	blobs.each do |blob|
	puts blob.name
	end
	end
	end

view raw blobstorage4.rb hosted with ❤ by GitHub

• Download Blobs

	def download(blob_name, output_file)
	blob, content = AZURE_BLOB_SERVICE.get_blob(CONTAINER,blob_name)
	File.open(output_file,"wb") {|f| f.write(content)}
	puts blob_name + " downloaded succesfully.."
	end

view raw blobstorage5.rb hosted with ❤ by GitHub

• Delete a Blob

	def delete(blob_name)
	AZURE_BLOB_SERVICE.delete_blob(CONTAINER, blob_name)
	puts blob_name + " deleted succesfully.."
	end

view raw blobstorage6.rb hosted with ❤ by GitHub

Writing Dynamic SQL in MyBatis

This post will take you through a several examples of creating a dynamic sql queries which you will come up in a day to day development using mybatis.

• Use of if statement

We can use the if statement where we need to conditionally include parts of a where clause.

eg: Search Employee. Employee name and role can be added as filter fields.

	<select id="searchEmployee" resultType="Employee">
	SELECT * FROM Employee
	WHERE status = 'ACTIVE'
	<if test="empName != null">
	AND empName LIKE #{empName}
	</if>
	<if test="empRole != null">
	AND empRole = #{empRole}
	</if>
	</select>

view raw ibatis1.xml hosted with ❤ by GitHub

• Use of choose, when, otherwise

What about switch statement in query where we need to choose only one case among many options.

	<select id="findEmployeesByLocation" resultType="Employee">
	SELECT * FROM Employee WHERE status = 'ACTIVE'
	<choose>
	<when test="locationType == 'local'">
	AND local_loc_code = #{loc_code}
	</when>
	<when test="locationType == 'remote'">
	AND local_loc_code = #{loc_code}
	</when>
	<otherwise>
	AND loc_code = #{loc_code}
	</otherwise>
	</choose>
	</select>

view raw ibatis2.xml hosted with ❤ by GitHub

• Use of where

When you have a query with multiple optional where clauses you may find a difficulty to build the query with correct prefix. MyBatis has a simple solution for this. It is where element. The where element knows to only insert "WHERE" if there is any content returned by the containing tags. Furthermore, if that content begins with "AND" or "OR", it knows to strip it off.

	<select id="searchEmployee" resultType="Employee">
	SELECT * FROM Employee
	<where>
	<if test="status != null">
	status = #{status}
	</if>
	<if test="empName != null">
	AND empName LIKE #{empName}
	</if>
	<if test="empRole != null">
	AND empRole = #{empRole}
	</if>
	</where>
	</select>

view raw ibatis3.xml hosted with ❤ by GitHub

• Use of set

The set element can be used to dynamically include columns to update, and leave out others.

	<update id="updateEmployee">
	update Employee
	<set>
	<if test="firstName != null">firstName=#{firstName},</if>
	<if test="lastName != null">lastName=#{lastName},</if>
	<if test="email != null">email=#{email},</if>
	<if test="mobileNo != null">mobileNo=#{mobileNo}</if>
	</set>
	where id=#{id}
	</update>

view raw ibatis4.xml hosted with ❤ by GitHub

• Use of foreach

Another common necessity for dynamic SQL is the need to iterate over a collection, often to build an IN condition.

	<select id="selectEmployeesIn" resultType="Employee">
	SELECT *
	FROM Employee
	WHERE id in
	<foreach item="item" index="index" collection="list"
	open="(" separator="," close=")">
	#{item}
	</foreach>
	</select>

view raw ibatis5.xml hosted with ❤ by GitHub

Import Data from a CSV file to a Cassandra Keysapce - Java

In this post I am giving a Java solution for importing data from a CSV file to a Cassandra Keyspace.

In the example given below I have used "opencsv" which is a very simple csv parser library for Java to read the data from the csv file. Opencsv is available under a commercial-friendly Apache 2.0 license.

	import au.com.bytecode.opencsv.CSVReader;
	import me.prettyprint.cassandra.serializers.StringSerializer;
	import me.prettyprint.cassandra.service.CassandraHostConfigurator;
	import me.prettyprint.hector.api.Cluster;
	import me.prettyprint.hector.api.Keyspace;
	import me.prettyprint.hector.api.ddl.ColumnFamilyDefinition;
	import me.prettyprint.hector.api.ddl.ComparatorType;
	import me.prettyprint.hector.api.factory.HFactory;
	import me.prettyprint.hector.api.mutation.Mutator;
	import java.io.FileReader;
	import java.io.IOException;
	import java.util.HashMap;
	import java.util.Map;
	public class DataPopulator {
	public static final String USERNAME_KEY = "username";
	public static final String PASSWORD_KEY = "password";
	public static void main(String[] args) throws IOException {
	String keyspaceName = "Test_KS";
	CSVReader reader = new CSVReader(new FileReader("TestList.csv"));
	String [] nextLine;
	Map<String, String> credentials = new HashMap<String, String>();
	credentials.put(USERNAME_KEY, "cassandra");
	credentials.put(PASSWORD_KEY, "cassandra");
	Cluster cluster = HFactory.getOrCreateCluster("MonarchCluster",
	new CassandraHostConfigurator("localhost:9160"), credentials);
	Keyspace keySpace = HFactory.createKeyspace(keyspaceName, cluster);
	ColumnFamilyDefinition cf = HFactory.createColumnFamilyDefinition(keyspaceName, "Test_List_CS", ComparatorType.UTF8TYPE);
	Mutator<String> mutator = HFactory.createMutator(keySpace, StringSerializer.get());
	while ((nextLine = reader.readNext()) != null) {
	mutator.insert(nextLine[0], cf.getName(), HFactory.createStringColumn("column1", nextLine[1]));
	mutator.insert(nextLine[0], cf.getName(), HFactory.createStringColumn("column2", nextLine[2]));
	}
	}
	}

view raw datapopcsv.java hosted with ❤ by GitHub

Test Protected and Private functions in php

Testing private and protected functions in php is normally done through testing the public function it calls. But sometimes you need to test the private or protected functions separately. How can we do this? Lets consider the following simple example.

	<?php
	class MyClass {
	protected function myProtectedMethod($param){
	return "Protected Method with param" . " " . $param;
	}
	}
	?>

view raw testpvtfuncs1.php hosted with ❤ by GitHub

	<?php
	require_once 'myClass.php';
	class MyTestClass extends PHPUnit_Framework_TestCase {
	public function testMyProtectedMethod(){
	$myClass = new MyClass();
	$value = $myClass->myProtectedMethod('param1');
	$this->assertEquals("Protected Method with param param1", $value);
	}
	}
	?>

view raw testpvtfuncs2.php hosted with ❤ by GitHub

When you try to run the test class you will get the following error. PHP Fatal error:  Call to private/protected method MyClass::myProtectedMethod() from context 'MyTestClass' After version 5.3.2 PHP's "Reflection Class" makes it possible to temporarily work around access modifiers. This is done using the setAccessible function. Then you need to change your test class as follows.

	<?php
	require_once 'myClass.php';
	class MyTestClass extends PHPUnit_Framework_TestCase {
	private function _callProtectedFunction($name, $params) {
	$class = new ReflectionClass('MyClass');
	$method = $class->getMethod($name);
	$method->setAccessible(true);
	return $method->invokeArgs(new MyClass(), $params);
	}
	public function testMyProtectedMethod() {
	$value = $this->_callProtectedFunction('myProtectedMethod', array('param1'));
	$this->assertEquals("Protected Method with param param1", $value);
	}
	}
	?>

view raw testpvtfuncs3.php hosted with ❤ by GitHub

You will be able to run the test case for your private/protected function now.

Automated Testing - GSoC 2012

For Google Summer of Code (GSoC) 2012 I submitted a proposal on "AutomatedTesting" project listed by phpmyadmin (PMA). Michal Čihař, Marc Delisle, Madhura Jayaratne and Stas Zarubin who is the last year GSoC contributor helped me a lot when I improve my patches and the proposal. Michal Čihař act as my mentor for my project in this summer of code.

PMA is a free software tool written in PHP, intended to handle the administration of MySQL over the web. Automated testing is a project idea which continues from the last year GSoC session which was partially done by Stas Zarubin. Expectation of the project is automate the testing in PMA by writing uni test cases and selenium test cases using phpunit and improve the code coverage. Last year Stas Zarubin has written some test cases for the PMA libraries and classes but couldn't complete all. In this time I am improving the written test cases coverage and write new test cases for the remaining libraries and classes. 

In the next series of blog post I will discuss more about my project in this summer.