bash - Detect column separators in awk -

-

i'm trying separate in various files initial *.txt file using awk. got following format. 

inline  xline   x    y     horizon  time     1       159  806313 939258 kf2      0.80 .... 81      149  805004 948030 fallriver 0.85965 .... 243     146  804252 965837 tensleepbbase 1.1862

in case separator fifth column (kf2,fallriver,tensleepbbase). idea iterate , break loop when value of fifth column change don't know how structure algorithm in awk.

the expected result 3 txt files. 1 each horizon key word:

file1.txt

inline  xline   x    y     horizon  time     1       159  806313 939258 kf2      0.80 ... end of kf2 horizon keyword

file2.txt

inline  xline   x    y     horizon  time     81      149  805004 948030 fallriver 0.85965 ... end of fallriver horizon keyword

....

thank you.

using input file,

inline  xline   x    y     horizon  time     1       159  806313 939258 kf2      0.80 2       9  806313 939258 kf2      0.80 3       59  806313 939258 kf2      0.80 81      149  805004 948030 fallriver 0.85965 82      345  5678   948030 fallriver 0.85965 243     146  804252 965837 tensleepbbase 1.1862

i this:

awk 'nr==1 { hdr=$0;next}            # pick column headers, , avoid other processing            { hrz=$5;                 # save current horizon              if(hrz!=oldhrz){        # check if horizon has changed                 if(length(oldhrz)>0)print "end of ",oldhrz > file                 file=++f ".txt"      # work out name of output file                 print hdr > file     # print column headers new file                 oldhrz=hrz           # remember current horizon              }               print > file            }      end   { print "end of ",hrz > file}' input.txt

output

1.txt

inline  xline   x    y     horizon  time 1       159  806313 939258 kf2      0.80 2       9  806313 939258 kf2      0.80 3       59  806313 939258 kf2      0.80 end of  kf2

2.txt

inline  xline   x    y     horizon  time 81      149  805004 948030 fallriver 0.85965 82      345  5678   948030 fallriver 0.85965 end of  fallriver

3.txt

inline  xline   x    y     horizon  time 243     146  804252 965837 tensleepbbase 1.1862 end of  tensleepbbase

Comments

Post a Comment

Popular posts from this blog

php - Zend Framework / Skeleton-Application / Composer install issue -

-
i trying create zend framework application using skeleton in netbeans. when run composer install, following error message: "c:\php\php.exe" "c:\composer\composer.phar" "--ansi" "--no-interaction" "update" "--dev" using deprecated option "dev". dev packages installed default now. loading composer repositories package information updating dependencies (including require-dev) requirements not resolved installable set of packages. problem 1 - package requires php >=5.5 php version (5.4.42) not satisfy requirement. problem 2 - installation request zendframework/zendframework 2.5.1 -> satisfiable zendframework/zendframework[2.5.1]. - zendframework/zendframework 2.5.1 requires php >=5.5 -> php version (5.4.42) not satisfy requirement. done. apparently, zend framework only needs php 5.3+ contradicts above. need use php 5.4. my composer.json following: { "name": "
Read more

c# - Better 64-bit byte array hash -

-
i need hash algorithm produces 64-bit hash code ( long ) fewer collisions string.gethashcode() , fast (no expensive calls cryptographic functions). here's implementation of fnv still shows 3% of collisions after testing 2 million random strings. need number way lower. void main() { const string chars = "abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz!#@$%^&*()_+}{\":?><,./;'[]0123456789\\"; const int n = 2000000; var random = new random(); var hashes = new hashset<long>(); int collisions = 0; for(int = 0; < n; i++) { var len = random.next(chars.length); var str = new char[len]; (int j = 0; j < len; j++) { str[j] = chars[random.next(chars.length)]; } var s = new string(str); if(!hashes.add(get64bithash( s ))) collisions++; } console.writeline("collision percentage after " + n + " random strings: " + ((doubl
Read more

python - PyCharm Type error Message -

-
i'm newbie trying out ml/dbn in python (3.4) under pycharm (comm.ed 4.5). following definition def make_thetas(xmin,xmax,n): xs = np.linespace(xmin,xmax,n) widths = (xs[1:] - xs[:-1])/2.0 thetas = xs[:-1] + widths return thetas throws error "class 'tuple' not define ' sub ', '-' operator cannot used on instance" on - operator on third line (widths = ....) ideas on how code running under pycharm - works alright in interactive python window. thx. to all, after g'g lot have found workaround seems work within pycharm. workaround because (even python newbie) expected python not need explicit typecasting, not when using datatypes imported lib such numpy. def make_thetas(xmin,xmax,n): xs = np.array(np.linspace(xmin,xmax,n)) widths = (xs[1:] - xs[:-1])/2.0 thetas = xs[:-1]+ widths return thetas using docstrings type-hinting such below did not work def make_thetas(xmin,xmax,n): "&q
Read more