[cti-users] The Cosive STIX Data Generator

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[cti-users] The Cosive STIX Data Generator

Terry MacDonald-2
Hi All,

As Patrick mentioned early last week, Cosive recently released the free online STIX Data Generator to automatically generate STIX content. It's purpose is twofold:
  • To help people learn more about STIX document structures
  • To help people test their STIX products
The STIX Data Generator allows users to select the version of STIX they wish to generate, the number of objects they want returned, and which objects they wish the generator will select from. A STIX document is then constructed to the users specifications.

Data generated by the STIX Data Generator is always within the http://stix.exampledata.org namespace, allowing vendors to easily differentiate test data from real production data. The stix.exampledata.org domain is owned by Cosive; we use it solely for test STIX data and we would like to invite anyone to use stix.exampledata.org as the namespace for your test STIX dataset too.

One useful feature is that the STIX Data Generator also has an API, allowing one to generate STIX documents using wget or curl from inside a script. That provides some nice possibilities for scripting automatic tests. Some basic API usage examples are:
curl 'https://api.cosive.com/sdg/v1/stix'  # basic form, STIX 1.2 w/ random objects
curl 'https://api.cosive.com/sdg/v1/stix?version=1.1.1'   # pick your STIX output version, 1.2 or 1.1.1
curl 'https://api.cosive.com/sdg/v1/stix?version=1.2&count=50&objects=url,domain'   # 50 URLs and domains, STIX 1.2
More information is available on the website: https://generator.cosive.com

We'd really appreciate feedback, especially around the objects included in the STIX Data Generator. If you have some recommendations on what we should work on next, we'd love to hear them! 

Cheers

Terry MacDonald, Chris Horsley and Kayne Naughton



M: <a href="tel:+61-407-203-026" target="_blank">+61-407-203-026

Reply | Threaded
Open this post in threaded view
|

Re: [cti-users] The Cosive STIX Data Generator

pmaroney
Terry,

Many thanks to you and your Team for this contribution to "our thing".  

I was planning on re-surfacing the legacy discussions around the "Test Dataset Initiative" and community conventions for the marking of "Test Data" to support large scale operational functional and performance testing of (commingled) CTI once the CTI TC Interoperability SC is established.

In the meantime, providing a method in the Cosive STIX Generator UI/API to override the default Namespace declarations would be very useful.

Patrick Maroney
President
Integrated Networking Technologies, Inc.
Desk: <a href="tel:(856)983-0001">(856)983-0001
Cell: <a href="tel:(609)841-5104">(609)841-5104
Email: [hidden email]




On Sun, Sep 20, 2015 at 1:11 AM -0700, "Terry MacDonald" <[hidden email]> wrote:

Hi All,

As Patrick mentioned early last week, Cosive recently released the free online STIX Data Generator to automatically generate STIX content. It's purpose is twofold:
  • To help people learn more about STIX document structures
  • To help people test their STIX products
The STIX Data Generator allows users to select the version of STIX they wish to generate, the number of objects they want returned, and which objects they wish the generator will select from. A STIX document is then constructed to the users specifications.

Data generated by the STIX Data Generator is always within the http://stix.exampledata.org namespace, allowing vendors to easily differentiate test data from real production data. The stix.exampledata.org domain is owned by Cosive; we use it solely for test STIX data and we would like to invite anyone to use stix.exampledata.org as the namespace for your test STIX dataset too.

One useful feature is that the STIX Data Generator also has an API, allowing one to generate STIX documents using wget or curl from inside a script. That provides some nice possibilities for scripting automatic tests. Some basic API usage examples are:
curl 'https://api.cosive.com/sdg/v1/stix'  # basic form, STIX 1.2 w/ random objects
curl 'https://api.cosive.com/sdg/v1/stix?version=1.1.1'   # pick your STIX output version, 1.2 or 1.1.1
curl 'https://api.cosive.com/sdg/v1/stix?version=1.2&count=50&objects=url,domain'   # 50 URLs and domains, STIX 1.2
More information is available on the website: https://generator.cosive.com

We'd really appreciate feedback, especially around the objects included in the STIX Data Generator. If you have some recommendations on what we should work on next, we'd love to hear them! 

Cheers

Terry MacDonald, Chris Horsley and Kayne Naughton



M: <a href="tel:&#43;61-407-203-026" target="_blank">+61-407-203-026

JA
Reply | Threaded
Open this post in threaded view
|

Re: [cti-users] The Cosive STIX Data Generator

JA
Thanks Terry & co.

Great initiative.
Regarding performance testing, I wonder if some folks there did some XML parsing libraries benchmarking?

(Fyi, I started some tooling, but beta release expected end of year, after RSA talk, and some FIFA16 games... Just attached 2 preview screenshots)

Keep it up!
Cheers


2015-09-20 16:25 GMT+03:00 Patrick Maroney <[hidden email]>:
Terry,

Many thanks to you and your Team for this contribution to "our thing".  

I was planning on re-surfacing the legacy discussions around the "Test Dataset Initiative" and community conventions for the marking of "Test Data" to support large scale operational functional and performance testing of (commingled) CTI once the CTI TC Interoperability SC is established.

In the meantime, providing a method in the Cosive STIX Generator UI/API to override the default Namespace declarations would be very useful.

Patrick Maroney
President
Integrated Networking Technologies, Inc.
Desk: <a href="tel:(856)983-0001" target="_blank">(856)983-0001
Cell: <a href="tel:(609)841-5104" target="_blank">(609)841-5104
Email: [hidden email]




On Sun, Sep 20, 2015 at 1:11 AM -0700, "Terry MacDonald" <[hidden email]> wrote:

Hi All,

As Patrick mentioned early last week, Cosive recently released the free online STIX Data Generator to automatically generate STIX content. It's purpose is twofold:
  • To help people learn more about STIX document structures
  • To help people test their STIX products
The STIX Data Generator allows users to select the version of STIX they wish to generate, the number of objects they want returned, and which objects they wish the generator will select from. A STIX document is then constructed to the users specifications.

Data generated by the STIX Data Generator is always within the http://stix.exampledata.org namespace, allowing vendors to easily differentiate test data from real production data. The stix.exampledata.org domain is owned by Cosive; we use it solely for test STIX data and we would like to invite anyone to use stix.exampledata.org as the namespace for your test STIX dataset too.

One useful feature is that the STIX Data Generator also has an API, allowing one to generate STIX documents using wget or curl from inside a script. That provides some nice possibilities for scripting automatic tests. Some basic API usage examples are:
curl 'https://api.cosive.com/sdg/v1/stix'  # basic form, STIX 1.2 w/ random objects
curl 'https://api.cosive.com/sdg/v1/stix?version=1.1.1'   # pick your STIX output version, 1.2 or 1.1.1
curl 'https://api.cosive.com/sdg/v1/stix?version=1.2&count=50&objects=url,domain'   # 50 URLs and domains, STIX 1.2
More information is available on the website: https://generator.cosive.com

We'd really appreciate feedback, especially around the objects included in the STIX Data Generator. If you have some recommendations on what we should work on next, we'd love to hear them! 

Cheers

Terry MacDonald, Chris Horsley and Kayne Naughton



M: <a href="tel:+61-407-203-026" target="_blank">+61-407-203-026




This publicly archived list provides a forum for asking questions,
offering answers, and discussing topics of interest on STIX,
TAXII, and CybOX.  Users and developers of solutions that leverage
STIX, TAXII and CybOX are invited to participate.

In order to verify user consent to OASIS mailing list guidelines
and to minimize spam in the list archive, subscription is required
before posting.

Subscribe: [hidden email]
Unsubscribe: [hidden email]
Post: [hidden email]
List help: [hidden email]
List archive: http://lists.oasis-open.org/archives/cti-users/
List Guidelines: http://www.oasis-open.org/maillists/guidelines.php
CTI Technical Committee: https://www.oasis-open.org/committees/cti/
Join OASIS: http://www.oasis-open.org/join/

STIXBuilderJA_Indicator.png (105K) Download Attachment
STIXBuilderJA_TTP.png (118K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [cti-users] The Cosive STIX Data Generator

Joep Gommers
@Sergey P;

Didn’t we do some XML parsing benchmarking that lead to the OpenTAXII/libtaxii library changes? Could you share with the group?

J-

From: Jerome Athias <[hidden email]>
Date: Sunday, September 20, 2015 at 4:23 PM
To: Patrick Maroney <[hidden email]>
Cc: Terry MacDonald <[hidden email]>, "[hidden email]" <[hidden email]>
Subject: Re: [cti-users] The Cosive STIX Data Generator

Thanks Terry & co.

Great initiative.
Regarding performance testing, I wonder if some folks there did some XML parsing libraries benchmarking?

(Fyi, I started some tooling, but beta release expected end of year, after RSA talk, and some FIFA16 games... Just attached 2 preview screenshots)

Keep it up!
Cheers


2015-09-20 16:25 GMT+03:00 Patrick Maroney <[hidden email]>:
Terry,

Many thanks to you and your Team for this contribution to "our thing".  

I was planning on re-surfacing the legacy discussions around the "Test Dataset Initiative" and community conventions for the marking of "Test Data" to support large scale operational functional and performance testing of (commingled) CTI once the CTI TC Interoperability SC is established.

In the meantime, providing a method in the Cosive STIX Generator UI/API to override the default Namespace declarations would be very useful.

Patrick Maroney
President
Integrated Networking Technologies, Inc.
Desk: <a href="tel:(856)983-0001" target="_blank">(856)983-0001
Cell: <a href="tel:(609)841-5104" target="_blank">(609)841-5104
Email: [hidden email]




On Sun, Sep 20, 2015 at 1:11 AM -0700, "Terry MacDonald" <[hidden email]> wrote:

Hi All,

As Patrick mentioned early last week, Cosive recently released the free online STIX Data Generator to automatically generate STIX content. It's purpose is twofold:
  • To help people learn more about STIX document structures
  • To help people test their STIX products
The STIX Data Generator allows users to select the version of STIX they wish to generate, the number of objects they want returned, and which objects they wish the generator will select from. A STIX document is then constructed to the users specifications.

Data generated by the STIX Data Generator is always within the http://stix.exampledata.org namespace, allowing vendors to easily differentiate test data from real production data. The stix.exampledata.org domain is owned by Cosive; we use it solely for test STIX data and we would like to invite anyone to use stix.exampledata.org as the namespace for your test STIX dataset too.

One useful feature is that the STIX Data Generator also has an API, allowing one to generate STIX documents using wget or curl from inside a script. That provides some nice possibilities for scripting automatic tests. Some basic API usage examples are:
curl 'https://api.cosive.com/sdg/v1/stix'  # basic form, STIX 1.2 w/ random objects
curl 'https://api.cosive.com/sdg/v1/stix?version=1.1.1'   # pick your STIX output version, 1.2 or 1.1.1
curl 'https://api.cosive.com/sdg/v1/stix?version=1.2&count=50&objects=url,domain'   # 50 URLs and domains, STIX 1.2
More information is available on the website: https://generator.cosive.com

We'd really appreciate feedback, especially around the objects included in the STIX Data Generator. If you have some recommendations on what we should work on next, we'd love to hear them! 

Cheers

Terry MacDonald, Chris Horsley and Kayne Naughton



M: <a href="tel:&#43;61-407-203-026" target="_blank">+61-407-203-026


JA
Reply | Threaded
Open this post in threaded view
|

Re: [cti-users] The Cosive STIX Data Generator

JA
I would be interested in case this one was evaluated http://www.ambiera.com/irrxml/

Cheers

2015-09-20 17:33 GMT+03:00 Joep Gommers <[hidden email]>:
@Sergey P;

Didn’t we do some XML parsing benchmarking that lead to the OpenTAXII/libtaxii library changes? Could you share with the group?

J-

From: Jerome Athias <[hidden email]>
Date: Sunday, September 20, 2015 at 4:23 PM
To: Patrick Maroney <[hidden email]>
Cc: Terry MacDonald <[hidden email]>, "[hidden email]" <[hidden email]>
Subject: Re: [cti-users] The Cosive STIX Data Generator

Thanks Terry & co.

Great initiative.
Regarding performance testing, I wonder if some folks there did some XML parsing libraries benchmarking?

(Fyi, I started some tooling, but beta release expected end of year, after RSA talk, and some FIFA16 games... Just attached 2 preview screenshots)

Keep it up!
Cheers


2015-09-20 16:25 GMT+03:00 Patrick Maroney <[hidden email]>:
Terry,

Many thanks to you and your Team for this contribution to "our thing".  

I was planning on re-surfacing the legacy discussions around the "Test Dataset Initiative" and community conventions for the marking of "Test Data" to support large scale operational functional and performance testing of (commingled) CTI once the CTI TC Interoperability SC is established.

In the meantime, providing a method in the Cosive STIX Generator UI/API to override the default Namespace declarations would be very useful.

Patrick Maroney
President
Integrated Networking Technologies, Inc.
Desk: <a href="tel:(856)983-0001" target="_blank">(856)983-0001
Cell: <a href="tel:(609)841-5104" target="_blank">(609)841-5104
Email: [hidden email]




On Sun, Sep 20, 2015 at 1:11 AM -0700, "Terry MacDonald" <[hidden email]> wrote:

Hi All,

As Patrick mentioned early last week, Cosive recently released the free online STIX Data Generator to automatically generate STIX content. It's purpose is twofold:
  • To help people learn more about STIX document structures
  • To help people test their STIX products
The STIX Data Generator allows users to select the version of STIX they wish to generate, the number of objects they want returned, and which objects they wish the generator will select from. A STIX document is then constructed to the users specifications.

Data generated by the STIX Data Generator is always within the http://stix.exampledata.org namespace, allowing vendors to easily differentiate test data from real production data. The stix.exampledata.org domain is owned by Cosive; we use it solely for test STIX data and we would like to invite anyone to use stix.exampledata.org as the namespace for your test STIX dataset too.

One useful feature is that the STIX Data Generator also has an API, allowing one to generate STIX documents using wget or curl from inside a script. That provides some nice possibilities for scripting automatic tests. Some basic API usage examples are:
curl 'https://api.cosive.com/sdg/v1/stix'  # basic form, STIX 1.2 w/ random objects
curl 'https://api.cosive.com/sdg/v1/stix?version=1.1.1'   # pick your STIX output version, 1.2 or 1.1.1
curl 'https://api.cosive.com/sdg/v1/stix?version=1.2&count=50&objects=url,domain'   # 50 URLs and domains, STIX 1.2
More information is available on the website: https://generator.cosive.com

We'd really appreciate feedback, especially around the objects included in the STIX Data Generator. If you have some recommendations on what we should work on next, we'd love to hear them! 

Cheers

Terry MacDonald, Chris Horsley and Kayne Naughton



M: <a href="tel:+61-407-203-026" target="_blank">+61-407-203-026